Learning of gestures by using vision and motion sensors

Observation of the user's gestures through stereoscopic vision and inertial motion sensors attached to the upper body of the user.

Learning and reproduction of a set of various gestures (waving goodbye, knocking on a door, dringking from a glass and writing of alphabet letters on a vertical board). For the last set of gestures, we see on the vidoe that the robot is able to generalize the motion by writing the alphabet letters on a different plane.

Go back to the list of videos