00:00
99
More
See all Show me
The video shows a Barrett WAM 7 DOFs manipulator learning to flip pancakes by reinforcement learning.
The motion is encoded in a mixture of basis force fields through an extension of Dynamic Movement Primitives (DMP) that represents the synergies across the different variables through stiffness matrices. An Inverse Dynamics controller with variable stiffness is used for reproduction.

The skill is first demonstrated via kinesthetic teaching, and then refined by Policy learning by Weighting Exploration with the Returns (PoWER) algorithm. After 50 trials, the robot learns that the first part of the task requires a stiff behavior to throw the pancake in the air, while the second part requires the hand to be compliant in order to catch the pancake without having it bounced off the pan.

Video credits:
Dr Petar Kormushev
Dr Sylvain Calinon
(Advanced Robotics Dept, Italian Institute of Technology)

Links to authors webpages:
kormushev.com
programming-by-demonstration.org/SylvainCalinon/

Link to publication describing the experiment:
programming-by-demonstration.org/papers/Kormushev-IROS2010.pdf

Link to publication on PoWER algorithm by Jens Kober and Jan Peters:
books.nips.cc/papers/files/nips21/NIPS2008_0089.pdf

Credits

Likes

See all likes
This conversation is missing your voice. Take five seconds to join Vimeo or log in.

Advertisement

About this video

MP4
00:01:39
  • 640x480, 8.42MB
  • Uploaded Fri July 16, 2010
  • Please join or log in to download

Statistics

Date Plays Comments
Totals 278K 187 9
Feb 14th 4 0 0
Feb 13th 57 0 0
Feb 12th 11 0 0
Feb 11th 10 0 0
Feb 10th 8 0 0
Feb 9th 21 0 0
Feb 8th 17 0 0