Site Search  

Resources » Publication Details

Publication Details

Reference TypeJournal Article
Author(s)Stulp, F.;Buchli, J.;Ellmer, A.;Mistry, M.;Theodorou, E.;Schaal, S.
TitleModel-free Reinforcement Learning of Impedance Control in Stochastic Environments
Journal/Conference/Book TitleAutonomous Mental Development, IEEE Transactions on
AbstractFor humans and robots, variable impedance control is an essential component for ensuring robust and safe physical interaction with the environment. Humans learn to adapt their impedance to specific tasks and environments; a capability which we continually develop and improve until we are well into our twenties. In this article, we reproduce functionally interesting aspects of learning impedance control in humans on a simulated robot platform. As demonstrated in numerous force field tasks, humans combine two strategies to adapt their impedance to perturbations, thereby minimizing position error and energy consumption: 1) if perturbations are unpredictable, subjects increase their impedance through co-contraction; 2) if perturbations are predictable, subjects learn a feed-forward command to offset the perturbation. We show how a 7-DOF simulated robot demonstrates similar behavior with our model-free reinforcement learning algorithm PI2, by applying deterministic and stochastic force fields to the robots end-effector. We show the qualitative similarity between the robot and human movements. Our results provide a biologically plausible approach to learning appropriate impedances purely from experience, without requiring a model of either body or environment dynamics. Not requiring models also facilitates autonomous development for robots, as pre-specified models cannot be provided for each environment a robot might encounter. View full abstract
Short TitleModel-free Reinforcement Learning of Impedance Control in Stochastic Environments
Custom 3papers2://publication/uuid/B6BC3D6B-AD38-41E4-885E-EE7EB96A2B52
Accession Number6227337
Electronic Resource Number10.1109/TAMD.2012.2205924
Link to PDF

Designed by: Nerses Ohanyan & Jan Peters
Page last modified on June 20, 2013, at 07:00 PM