Sensorimotor Deep Learning

In this project we are developing deep learning methods for robotics. Deep learning is a branch of machine learning that is concerned with learning structure, representations, and underlying patterns in complex “raw” data, such as images and sounds. Traditionally, these methods have been applied to passive tasks, like recognizing cars or pedestrians in camera images, where the method is “trained” by presenting it with hand-labeled examples of the objects that must be recognized. In this project we aim to develop deep learning techniques that can be deployed on a robot to allow it to learn directly from trial-and-error, where the only information provided by the teacher is the degree to which it is succeeding at the current task.
This UC Berkeley Press Release describes some of our work.

The following video illustrates some of our results.

The following video explains some of the key ideas behind our work.