Yixin Zhu

Yixin Zhu

Assistant Professor

PKU Institute for AI

Biography

Dr. Yixin Zhu received a Ph.D. degree (‘18) from UCLA advised by Prof. Song-Chun Zhu. His research builds interactive AI by integrating high-level common sense (functionality, affordance, physics, causality, intent) with raw sensory inputs (pixels and haptic signals) to enable richer representation and cognitive reasoning on objects, scenes, shapes, numbers, and agents. Dr. Zhu directs the PKU CoRe Lab, working on abstract reasoning, visually grounded reasoning, and interactive reasoning.

[CV] [Dissertation]

Getting Started 帮你自学大学四年AI的所有内容
通班相关文章 汇集官方和权威渠道对通班的报道

Pre-Print

[arXiv23] Diffusion-based Generation, Optimization, and Planning in 3D Scenes
[arXiv22] CHAIRS: Towards Full-Body Articulated Human-Object Interaction
[arXiv22] On the Complexity of Bayesian Generalization
[arXiv22] Understanding Embodied Reference with Touch-Line Transformer
[arXiv22] Neural-Symbolic Recursive Machine for Systematic Generalization
[arXiv22] GenDexGrasp: Generalizable Dexterous Grasping
[arXiv22] EST: Evaluating Scientific Thinking in Artificial Agents
[arXiv22] MPI: Evaluating and Inducing Personality in Pre-trained Language Models
[arXiv22] PartAfford: Part-level Affordance Discovery from 3D Objects
[arXiv21] HALMA: Humanlike Abstraction Learning Meets Affordance in Rapid Problem Solving
[arXiv21] A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semantics

Publications

[Engineering23] A Reconfigurable Data Glove for Reconstructing Physical and Virtual Grasps
[ICML22] Latent Diffusion Energy-Based Model for Interpretable Text Modeling
[JCB2022] Sharing Rewards Undermines Coordinated Hunting
[CogSci22] What Is the Point? A Theory of Mind Model of Relevance
[NeurIPS21] Unsupervised Foreground Extraction via Deep Region Competition
[ICCV21] YouRefIt: Embodied Reference Understanding with Language and Gesture
[IROS21] Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations

Students

*
Chuyue Tang

Chuyue Tang

CoRe, TongClass@PKU ‘20, Harvard Visiting Student

Kewen Wu

Kewen Wu

CoRe, Undergrad@THU, ‘19

Shiji Xin

Shiji Xin

CoRe, TuringClass@PKU, ‘19

Yida Niu

Yida Niu

Human-Robot Teaming, Ph.D.@PKU, ‘23

Jieming Cui

Jieming Cui

CV, Ph.D.@PKU, ‘23

Shiqian Li

Shiqian Li

CoRe, Ph.D.@PKU, ‘22

Manjie Xu

Manjie Xu

CoRe, M.Sc.@BIT, ‘22

Nan Jiang

Nan Jiang

CV, Ph.D.@PKU, ‘22

Guangyuan Jiang

Guangyuan Jiang

CoRe, TongClass@PKU, ‘20

Yuzhe Shi

Yuzhe Shi

CoRe, Undergrad@HUST, ‘18

Alumni

  • Wenhe Zhang, Master, Computer Science, UCLA, 2020 Fall
  • Xiaojian Ma, Master, Computer Science, UCLA, 2019 Fall
  • Xiaolin Fang, Ph.D., CSAIL, MIT, 2019 Fall
  • Shu Wang, Ph.D., Statistics, UCLA, 2018 Fall
  • Wenwen Si, Master, Computer Vision, CMU, 2018 Fall
  • Hangxin Liu, Ph.D., Computer Science, UCLA, 2018 Spring
  • Jenny Lin, Ph.D., Computer Science, CMU, 2017 Fall
  • Mark Edmonds, Ph.D., Computer Science, UCLA, 2017 Fall
  • Tian Ye, Master, Robotics, CMU, 2017 Fall
  • Feng Gao, Master, Statistics, UCLA, 2017 Fall
  • Xu Xie, Master, Statistics, UCLA, 2017 Fall
  • Xingwen Guo, Master, Computer Science, Yale, 2017 Fall
  • Chi Zhang, Master, Computer Science, UCLA, 2017 Fall
  • Jingyu Shao, Master, Statistics, UCLA, 2016 Winter
  • Yutong Zhang, Master in Computer Science, UCLA, 2015 Fall