wu-qing-157 Goto Github PK
Name: Yi Gu
Type: User
Company: Shanghai Jiao Tong University
Name: Yi Gu
Type: User
Company: Shanghai Jiao Tong University
When told to understand the shape of a new object, the most instinctual approach is to pick it up and inspect it with your hand and eyes in tandem. Here, touch provides high fidelity localized information while vision provides complementary global context. However, in 3D shape reconstruction, the complementary fusion of visual and haptic modalities remains largely unexplored. In this paper, we study this problem and present an effective chart-based approach to fusing vision and touch, which leverages advances in graph convolutional networks. To do so, we introduce a dataset of simulated touch and vision signals from the interaction between a robotic hand and a large array of 3D objects. Our results show that (1) leveraging both vision and touch signals consistently improves single-modality baselines, especially when the object is occluded by the hand touching it; (2) our approach outperforms alternative modality fusion methods and strongly benefits from the proposed chart-based structure; (3) reconstruction quality boosts with the number of grasps provided; and (4) the touch information not only enhances the reconstruction at the touch site but also extrapolates to its local neighborhood.
Team repository for Aerial-Ace, a SJTU ICPC Team
A learning environment for man-made Interactive Fiction games.
Python bindings for llama.cpp
Models and examples built with TensorFlow
This repository is only used to submit my compiler
Track real-time Genshin Impact stats in your macOS menubar
--set private
A RISC-V simulator
This repository contains the source code of the EMNLP 2020 paper Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning.
A Homework for Computer Architecture at SJTU
A modular RL library to fine-tune language models to human preferences
This repository keeps my scripts used when I work as a co-coach at SJTU-ACM team.
This repository keeps my review notes for classes at SJTU.
SJTU DataStructure STLite
朋友圈转发截图生成工具
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
This is a backup of my z shell config
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.