Autonomous learning of multimodal internal models for robots using multiple sources of information

Add to your list(s) Download to your calendar using vCal

• Martina Zambelli, Deepmind
• Thursday 08 March 2018, 14:00-15:00
• Cambridge University Engineering Department, Lecture Room 12.

If you have a question about this talk, please contact Alberto Padoan.

Robots can learn new skills by autonomously acquiring internal models to use for action prediction, planning and control. Humans are a successful example of autonomous learning: internal models are developed through a learning process, which starts in the first months of infants’ life, based on experience and exploration. Similarly, through autonomous exploration a robot can bootstrap internal models of its own sensorimotor system that enable it to predict the consequences of its actions (forward models) or the production of new actions to reach target states (inverse models). The use of multiple sources of information can benefit such autonomous learning process. I will first introduce an ensemble learning method that combines multiple prediction models to build forward models. Then, I will illustrate how the use of multiple sensory modalities (e.g. vision, touch, proprioception) plays a fundamental role in learning and performing multimodal tasks (such as playing a piano keyboard). Finally, I will present a multimodal deep variational auto-encoder architecture that allows a humanoid iCub robot to predict and imitate other agents’ actions, based only on its own learned internal model.

This talk is part of the CUED Control Group Seminars series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• CUED Control Group Seminars
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge University Engineering Department Talks
• Cambridge University Engineering Department, Lecture Room 12
• Cambridge talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Computational Continuum Mechanics Group Seminars
• Featured lists
• Information Engineering Division seminar list
• Interested Talks
• School of Technology
• Signal Processing and Communications Lab Seminars
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.