RI Seminar: Stefan Schaal : From Movement Primitives to Associative Skill Memories
Stefan Schaal
Professor of Computer Science, Neuroscience, and Biomedical Engineering, University of Southern California
March 28, 2014
Abstract
Controlling a complex movement system requires making perceptual and control decisions at every moment of time, and learning and adaptation to improve the system's performance. High dimensional continuous state-action spaces still pose significant scaling problems for learning algorithms to find (approximately) optimal solutions, and appropriate task descriptions or cost functions require a large amount of human guidance. In order to address autonomous skillful movement generation in complex robot and task scenarios, we have been working on a variety of subproblems to facilitate robust task achievement. Among these topics are general representations for movement in form of movement primitives, trajectory-based reinforcement learning with path integral reinforcement learning, and inverse reinforcement learning to extract the "intent" of observed behavior. However, this "action centric" view of skill acquisition needs to be extended with a stronger perceptual component, as, in the end, it is the entire perception-action-learning loop that could be considered the key element to address, rather than isolated components of this loop. In some tentative initial research, we have been exploring Associative Skill Memories, i.e., the simple idea to start memorizing all sensory events and their statistics together with each movement skill. This concepts opens a wide spectrum of adding predictive, corrective, and switching behaviors in motor skills, and may create an interesting foundation to automatically generate the graphs underlying complex sequential motor skills. Our research results will be illustrated in various experiments with complex anthropomorphic robot systems.
Speaker Biography
Stefan Schaal is Professor of Computer Science, Neuroscience, and Biomedical Engineering at the University of Southern California, and a Founding Director of the Max-Planck-Insitute for Intelligent Systems in Tuebingen, Germany. He is also an Invited Researcher at the ATR Computational Neuroscience Laboratory in Japan, where he held an appointment as Head of the Computational Learning Group during an international ERATO project, the Kawato Dynamic Brain Project (ERATO/JST). Dr. Schaal's research interests include topics of statistical and machine learning, neural networks, computational neuroscience, functional brain imaging, nonlinear dynamics, nonlinear control theory, and biomimetic robotics. He applies his research to problems of artificial and biological motor control and motor learning, focusing on both theoretical investigations and experiments with human subjects and anthropomorphic robot equipment.
Видео RI Seminar: Stefan Schaal : From Movement Primitives to Associative Skill Memories канала cmurobotics
Professor of Computer Science, Neuroscience, and Biomedical Engineering, University of Southern California
March 28, 2014
Abstract
Controlling a complex movement system requires making perceptual and control decisions at every moment of time, and learning and adaptation to improve the system's performance. High dimensional continuous state-action spaces still pose significant scaling problems for learning algorithms to find (approximately) optimal solutions, and appropriate task descriptions or cost functions require a large amount of human guidance. In order to address autonomous skillful movement generation in complex robot and task scenarios, we have been working on a variety of subproblems to facilitate robust task achievement. Among these topics are general representations for movement in form of movement primitives, trajectory-based reinforcement learning with path integral reinforcement learning, and inverse reinforcement learning to extract the "intent" of observed behavior. However, this "action centric" view of skill acquisition needs to be extended with a stronger perceptual component, as, in the end, it is the entire perception-action-learning loop that could be considered the key element to address, rather than isolated components of this loop. In some tentative initial research, we have been exploring Associative Skill Memories, i.e., the simple idea to start memorizing all sensory events and their statistics together with each movement skill. This concepts opens a wide spectrum of adding predictive, corrective, and switching behaviors in motor skills, and may create an interesting foundation to automatically generate the graphs underlying complex sequential motor skills. Our research results will be illustrated in various experiments with complex anthropomorphic robot systems.
Speaker Biography
Stefan Schaal is Professor of Computer Science, Neuroscience, and Biomedical Engineering at the University of Southern California, and a Founding Director of the Max-Planck-Insitute for Intelligent Systems in Tuebingen, Germany. He is also an Invited Researcher at the ATR Computational Neuroscience Laboratory in Japan, where he held an appointment as Head of the Computational Learning Group during an international ERATO project, the Kawato Dynamic Brain Project (ERATO/JST). Dr. Schaal's research interests include topics of statistical and machine learning, neural networks, computational neuroscience, functional brain imaging, nonlinear dynamics, nonlinear control theory, and biomimetic robotics. He applies his research to problems of artificial and biological motor control and motor learning, focusing on both theoretical investigations and experiments with human subjects and anthropomorphic robot equipment.
Видео RI Seminar: Stefan Schaal : From Movement Primitives to Associative Skill Memories канала cmurobotics
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![RI Seminar: Jan Peters : Motor Skill Learning: From Simple Skills to Table Tennis and Manipulation](https://i.ytimg.com/vi/73sdZxAtG_4/default.jpg)
![Dynamic Movement Primitives](https://i.ytimg.com/vi/Ge0GduY1rtE/default.jpg)
![Dynamic movement primitives](https://i.ytimg.com/vi/IV8Eze9Hxrc/default.jpg)
![Variational Autoencoders](https://i.ytimg.com/vi/9zKuYvjFFS8/default.jpg)
![Machine Learning: Living in the Age of AI | A WIRED Film](https://i.ytimg.com/vi/ZJixNvx9BAc/default.jpg)
![Complex Motor Stereotypies - Olivia's Story Growing Up With Stereotypic Movement Disorder](https://i.ytimg.com/vi/fw5B2wxrYAc/default.jpg)
![RI Seminar: Deepak Pathak : Learning to Generalize beyond Training](https://i.ytimg.com/vi/Oabu6Gz1op0/default.jpg)
![ICRA2020 Pitch Video: Motion Primitives-based Path Planning for Fast and Agile Exploration](https://i.ytimg.com/vi/aT9F4gRjyJ0/default.jpg)
![Finally, Deformation Simulation... in Real Time! 🚗](https://i.ytimg.com/vi/F0QwAhUnpr4/default.jpg)
![](https://i.ytimg.com/vi/A1uEkKebHNM/default.jpg)
![DeepGait: Planning and Control of Quadrupedal Gaits using Deep Reinforcement Learning (Presentation)](https://i.ytimg.com/vi/jIKhnWzcdbg/default.jpg)
![Michael Black: Estimating Human Motion: Past, Present, and Future](https://i.ytimg.com/vi/5jU9rIqBz7M/default.jpg)
![A Modular Framework for Motion Planning with Feedback-Based Motion Primitives](https://i.ytimg.com/vi/kla2VXlxGnc/default.jpg)
![RI Seminar: Gustav Eje Henter : Move over, MSE! – New probabilistic models of motion](https://i.ytimg.com/vi/vzie55q42-c/default.jpg)
![RI Seminar: Mac Schwager : Enabling Robots to Cooperate & Compete: Distributed Optimization...](https://i.ytimg.com/vi/PTGaTYxhKwE/default.jpg)
![RI Seminar: Heni Ben Amor : Human-Robot Interactive Collaboration & Communication](https://i.ytimg.com/vi/eIKAQH6cvi8/default.jpg)
![RI Seminar: Sidd Srinivasa: Robotic Manipulation...](https://i.ytimg.com/vi/--PIIkzufaQ/default.jpg)
!["New Connections between Motion Planning and Machine Learning" - Sidd Srinivasa](https://i.ytimg.com/vi/adrVlZegiR0/default.jpg)
![MIT 6.S191 (2020): Generalizable Autonomy for Robot Manipulation](https://i.ytimg.com/vi/8Kn4Gi8iSYQ/default.jpg)
![KUKA Roboter programmieren: Erstes Bewegungsprogramm mit PTP und Linear](https://i.ytimg.com/vi/N9D7IuuJiHk/default.jpg)