Liu, J., Li, C., Wang, S., Dong, Z., Tang, Z., Calinon, S., Li, M. and Chen, F. (2024)
Learning Goal-oriented Bimanual Dough Rolling Using Dynamic Heterogeneous Graph Based on Human Demonstration
In Proc. IEEE Intl Conf. on Robotics and Biomimetics (ROBIO).
Abstract
Soft object manipulation poses significant challenges for robots, requiring effective techniques for state representation and manipulation policy learning. State representation involves capturing the dynamic changes in the environment, while manipulation policy learning focuses on establishing the relationship between robot actions and state transformations to achieve specific goals. To address these challenges, this research paper introduces a novel approach: a dynamic heterogeneous graph-based model for learning goal-oriented soft object manipulation policies. The proposed model utilizes graphs as a unified representation for both states and policy learning. By leveraging the dynamic graph, we can extract crucial information regarding object dynamics and manipulation policies. Furthermore, the model facilitates the integration of demonstrations, enabling guided policy learning. To evaluate the efficacy of our approach, we designed a dough rolling task and conducted experiments using both a differentiable simulator and a real-world humanoid robot. Additionally, several ablation studies were performed to analyze the effect of our method, demonstrating its superiority in achieving human-like behavior.
Bibtex reference
@inproceedings{Liu24ROBIO,
author={Liu, J. and Li, C. and Wang, S. and Dong, Z. and Tang, Z. and Calinon, S. and Li, M. and Chen, F.},
title={Learning Goal-oriented Bimanual Dough Rolling Using Dynamic Heterogeneous Graph Based on Human Demonstration},
booktitle={{IEEE} Intl Conf. on Robotics and Biomimetics ({ROBIO})},
year={2024}
}