Contributor: Zeyu Zhang
Reading list
survey/review/perspective paper book
Required - Mirroring and Imitation
- The Mirror-Neuron System, Annual Review of Neuroscience 2004
- The anthropomorphic brain: The mirror neuron system responds to human and robotic actions, NeuroImage 2007
- A survey of robot learning from demonstration, RAS 2009
Required - Tool
- The cognitive bases of human tool use, BBS 2012
- The neural bases of complex tool use in humans, TiSC 2004
- Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoning, PNAS 2020
Optional - Mirroring and Imitation: Observational Studies
- Rational imitation in preverbal infants, Science 2002
- When pliers become fingers in the monkey motor system, PNAS 2018
- Extending the mirror neuron system model, I: Audible actions and invisible grasps, Biological Cybernetics 2006
- Causal knowledge and imitation/emulation switching in chimpanzees (Pan troglodytes) and children (Homo sapiens), Animal Cognition 2005
- Copying actions and copying outcomes: Social learning through the second year, Developmental Psychology 2006
- The hidden structure of overimitation, PNAS 2007
- Imitation of causally opaque versus causally transparent tool use by 3-and 5-year-old children, Animal Cognition 2007
- Emulation, imitation, over-imitation and the scope of culture for child and chimpanzee, Philos. Trans. R. Soc. B 2009
- ‘Over-imitation’: A review and appraisal of a decade of research, Developmental Review 2019
- EEG evidence for mirror neuron activity during the observation of human and robot actions: Toward an analysis of the human qualities of interactive robots, Neurocomputing 2007
- Imitative learning of artificial fruit processing in children (Homo sapiens) and chimpanzees (Pan troglodytes), Jounal of Comparative Psychology 1996
- Imitation in Animals and Artifacts, MIT Press (2002)
Optional - Mirroring and Imitation: Computational Models
- An Algorithmic Perspective on Imitation Learning, Foundations and Trends in Robotics 2018
- Theories and computational models of affordance and mirror systems: An integrative review, Neuroscience & Biobehavioral Reviews 2013
- Feeling the Force: Integrating Force and Pose for Fluent Discovery through Imitation Learning to Open Medicine Bottles, IROS 2017
- Human-Guided Trajectory Adaptation for Tool Transfer, AAMAS 2019
- Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions, ICRA 2017
- Acquiring and Generalizing the Embodiment Mapping From Human Observations to Robot Skills, RA-L 2016
- Mirroring without Overimitation: Learning Functionally Equivalent Manipulation Actions, AAAI 2019
- On-line Imitative Interaction with a Humanoid Robot Using a Dynamic Neural Network Model of a Mirror System, Adaptive Behavior 2004
- Policy Search for Motor Primitives in Robotics, NeurIPS 2008
- Robot learning from demonstration by constructing skill trees, IJRR 2011
- Solving the Rubik’s cube with deep reinforcement learning and search, Nature Machine Intelligence 2019
- Learning Dexterous In-Hand Manipulation, IJRR 2019
Optional - Tool: Observational Studies
- Shaping of hooks in new caledonian crows, Science 2002
- Tool Use and Causal Cognition, Oxford University Press (2011)
- Observational learning of tool-use by young chimpanzees, Human Evolution 1987
- Experimental evidence for the co-evolution of hominin tool-making teaching and language, Nature Communication 2015
- Neural correlates of Early Stone Age toolmaking: technology, language and cognition in human evolution, Philos. Trans. R. Soc. B 2008
- Cognitive insights from tool use in nonhuman animals, APA Handbook of Comparative Psychology: Volume 2: Perception, Learning, and Cognition (2017)
- Stone toolmaking and the evolution of human culture and cognition, Philos. Trans. R. Soc. B 2011
- Is there a link between the crafting of tools and the evolution of cognition?, Cognitive Science 2014
Optional - Tool: Computational Models
- Robot tool use: A survey, Frontiers in Robotics and AI 2023
- Understanding Physical Effects for Effective Tool-use, RA-L 2022
- How to Select and Use Tools?: Active Perception of Target Objects Using Multimodal Deep Learning, RA-L 2021
- Understanding Tools: Task-Oriented Object Modeling, Learning, and Recognition, CVPR 2015
- A Causal Approach to Tool Affordance Learning, IROS 2020
- ToolNet: Using Commonsense Generalization for Predicting Tool Use for Robot Plan Synthesis, Advances & Challenges in Imitation Learning for Robotics Workshop in RSS 2020
- Force-and-Motion Constrained Planning for Tool Use, IROS 2019
- Autonomous Tool Construction Using Part Shape and Attachment Prediction, RSS 2019
- Improvisation through Physical Understanding: Using Novel Objects as Tools with Visual Foresight, RSS 2019
- Tool Macgyvering: Tool Construction Using Geometric Reasoning, ICRA 2019
- KETO: Learning Keypoint Representations for Tool Manipulation, ICRA 2020
- A Model-Based Approach to Finding Substitute Tools in 3D Vision Data, ICRA 2016
- Affordance Detection of Tool Parts from Geometric Features, ICRA 2015
- Self-supervised learning of tool affordances from 3D tool representation through parallel SOM mapping, ICRA 2017
- Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning, RSS 2018
Essay
The tool-use ability has traditionally been regarded as an indicator of intelligence, separating humans from animals. After reading part of the above literature and watching this video, do you think we can build an intelligent agent that uses tools like the crow in the video by adopting and integrating existing work in to a super system. Justify your answer. If not, what else need to be explored to enable an agent to use a tool in a more practical and complex environment.