Generalization

Neural Force Field: Learning Generalized Physical Representation from a Few Examples

Physical reasoning is a remarkable human ability that enables rapid learning and generalization from limited experience. Current AI …

Shiqian Li, Ruihong Shen, Chi Zhang, Yixin Zhu

Neural Force Field: Learning Generalized Physical Representation from a Few Examples

[T-RO24] Tac-Man: Tactile-Informed Prior-Free Manipulation of Articulated Objects

Integrating robotics into human-centric environments such as homes, necessitates advanced manipulation skills as robotic devices will …

Zihang Zhao, Yuyang Li, Wanlin Li, Zhenghao Qi, Lecheng Ruan, Yixin Zhu, Kaspar Althoefer

[IROS24] Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representations

Autonomous robotic systems capable of learning novel manipulation tasks are poised to transform industries from manufacturing to …

Puhao Li, Tengyu Liu, Yuyang Li, Muzhi Han, Haoran Geng, Shu Wang, Yixin Zhu, Song-Chun Zhu, Siyuan Huang

[ECCV24] Zero-Shot Image Feature Consensus with Deep Functional Maps

Correspondences emerge from large-scale vision models trained for generative and discriminative tasks. This has been revealed and …

Xinle Cheng, Congyue Deng, Adam Harley, Yixin Zhu, Leonidas Guibas

Dexterous Functional Pre-Grasp Manipulation with Diffusion Policy

In real-world scenarios, objects often require repositioning and reorientation before they can be grasped, a process known as pre-grasp …

Tianhao Wu, Yunchong Gan, Mingdong Wu, Jingbo Cheng, Yaodong Yang, Yixin Zhu, Hao Dong

[RA-L24] Grasp Multiple Objects with One Hand

The intricate kinematics of the human hand enable simultaneous grasping and manipulation of multiple objects, essential for tasks such …

Yuyang Li, Bo Liu, Yiran Geng, Puhao Li, Yaodong Yang, Yixin Zhu, Tengyu Liu, Siyuan Huang

[ICLR24] I-PHYRE: Interactive Physical Reasoning

Current evaluation protocols predominantly assess physical reasoning in stationary scenes, creating a gap in evaluating agents’ …

Shiqian Li, Kewen Wu, Chi Zhang, Yixin Zhu

[ICLR24] SparseDFF: Sparse-View Feature Distillation for One-Shot Dexterous Manipulation

Humans demonstrate remarkable skill in transferring manipulation abilities across objects of varying shapes, poses, and appearances, a …

Qianxu Wang, Haotong Zhang, Congyue Deng, Yang You, Hao Dong, Yixin Zhu, Leonidas Guibas

[ICLR24] Neural-Symbolic Recursive Machine for Systematic Generalization

Current learning models often struggle with human-like systematic generalization, particularly in learning compositional rules from …

Qing Li, Yixin Zhu, Yitao Liang, Ying Nian Wu, Song-Chun Zhu, Siyuan Huang

[NeurIPS23] Active Reasoning in an Open-World Environment

Recent advances in vision-language learning have achieved notable success on complete-information question-answering datasets through …

Manjie Xu, Guangyuan Jiang, Wei Liang, Chi Zhang, Yixin Zhu

[NeurIPS23] Active Reasoning in an Open-World Environment