Calinon, S. and Billard, A. (2007)
Incremental Learning of Gestures by Imitation in a Humanoid Robot
In Proc. of the ACM/IEEE Intl Conf. on Human-Robot Interaction (HRI), Arlington, VA, USA, pp. 255-262.

Abstract

We present an approach to teach incrementally human gestures to a humanoid robot. The learning process consists of first projecting the movement data in a latent space and encoding the resulting signals in a Gaussian Mixture Model (GMM). We compare the performance of two incremental training procedures against a batch training procedure. Qualitative and quantitative evaluations are performed on data acquired from motion sensors attached to a human demonstrator and data acquired by kinesthetically demonstrating the task to the robot. We present experiments to show that these different modalities can be used to teach incrementally basketball officials' signals to a HOAP-3 humanoid robot.

Bibtex reference

@inproceedings{Calinon07HRI,
  author = "S. Calinon and A. Billard",
  title = "Incremental Learning of Gestures by Imitation in a Humanoid Robot",
  booktitle = "Proceedings of the {ACM/IEEE} International Conference on Human-Robot Interaction ({HRI})",
  year = "2007",
  month="March",
  location="Arlington, VA, USA",
  pages="255--262"
}

Video

Final reproduction of communicative gestures used by Basketball officials, where the robot incrementally refines its motion through the user's support.

Source codes

Download

  Download GMM incremental sourcecode

Usage

Unzip the file and run 'demo1' or 'demo2' in Matlab.

References


Demo 1 - Demonstration of an incremental learning process of Gaussian Mixture Model (GMM) using a direct update method

The demonstration loads a dataset consisting of several trajectories which are presented one-by-one to update the GMM parameters by using an incremental version of the Expectation-Maximization (EM) algorithm (direct update method). The learning mechanism only uses the latest observed trajectory to update the models (no historical data is used).

Demo 2 - Demonstration of an incremental learning process of Gaussian Mixture Model (GMM) using a generative method

The demonstration loads a dataset consisting of several trajectories which are presented one-by-one to update the GMM parameters by generating stochastically a new dataset from the current model, adding the new trajectory to this dataset and updating the GMM parameters using the resulting dataset, through a standard Expectation-Maximization (EM) algorithm (generative method). The learning mechanism only uses the latest observed trajectory to update the models (no historical data is used).

Go back to the list of publications