Liu, P., Günster, J., Funk, N., Gröger, S., Chen, D., Bou Ammar, H., Jankowski, J., Marić, A., Calinon, S., Orsula, A., Olivares-Mendez, M., Zhou, H., Lioutikov, R., Neumann, G., Likmeta, A., Zhalehmehrabi, A., Bonenfant, T., Restelli, M., Tateo, D., Liu, Z. and Peters, J. (2024)
A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics
Advances in Neural Information Processing Systems (NeurIPS)
Abstract
Machine learning methods have a groundbreaking impact in many application domains, but their application on real robotic platforms is still limited. Despite the many challenges associated with combining machine learning technology with robotics, robot learning remains one of the most promising directions for enhancing the capabilities of robots. When deploying learning-based approaches on real robots, extra effort is required to address the challenges posed by various factors in the real world. To investigate the key factors influencing real-world deployment and to encourage original solutions from different researchers, we organized the Robot Air Hockey Challenge at the NeurIPS 2023 conference. We selected the air hockey task as a benchmark, encompassing low-level robotics problems and high-level tactics. Different from other machine learning-centric benchmarks, participants need to tackle practical challenges in robotics, such as the sim-to-real gap, the low-level control issues, the safety problem, real-time requirements, and limited availability to real-world data. The competition's results show that learning-based approaches with prior knowledge integration still outperform the data-driven approaches when building a deployable robotics solution. The ablation study provides us insights into which real-world factors may be overlooked when building a learning-based solution. The real-world air hockey deployment of best-performing agents sets the foundation for future competitions and follow-up research directions.
Bibtex reference
@inproceedings{Liu24NEURIPS,
author={Liu, P. and G\"unster, J. and Funk, N. and Gr\"oger, S. and Chen, D. and Bou Ammar, H. and Jankowski, J. and Mari\'c, A. and Calinon, S. and Orsula, A. and Olivares-Mendez, M. and Zhou, H. and Lioutikov, R. and Neumann, G. and Likmeta, A. and Zhalehmehrabi, A. and Bonenfant, T. and Restelli, M. and Tateo, D. and Liu, Z. and Peters, J.},
title={A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics},
booktitle={Advances in Neural Information Processing Systems ({NeurIPS})},
year={2024}
}