ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulation

Bibliographic Details
Title: ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulation
Authors: Liu, Wenhai, Wang, Junbo, Wang, Yiming, Wang, Weiming, Lu, Cewu
Publication Year: 2024
Collection: Computer Science
Subject Terms: Computer Science - Robotics
More Details: In most contact-rich manipulation tasks, humans apply time-varying forces to the target object, compensating for inaccuracies in the vision-guided hand trajectory. However, current robot learning algorithms primarily focus on trajectory-based policy, with limited attention given to learning force-related skills. To address this limitation, we introduce ForceMimic, a force-centric robot learning system, providing a natural, force-aware and robot-free robotic demonstration collection system, along with a hybrid force-motion imitation learning algorithm for robust contact-rich manipulation. Using the proposed ForceCapture system, an operator can peel a zucchini in 5 minutes, while force-feedback teleoperation takes over 13 minutes and struggles with task completion. With the collected data, we propose HybridIL to train a force-centric imitation learning model, equipped with hybrid force-position control primitive to fit the predicted wrench-position parameters during robot execution. Experiments demonstrate that our approach enables the model to learn a more robust policy under the contact-rich task of vegetable peeling, increasing the success rates by 54.5% relatively compared to state-ofthe-art pure-vision-based imitation learning. Hardware, code, data and more results can be found on the project website at https://forcemimic.github.io.
Comment: 8 pages, 7 figures, accepted by 2025 IEEE International Conference on Robotics and Automation (ICRA 2025), the first three authors contribute equally, project website at https://forcemimic.github.io
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2410.07554
Accession Number: edsarx.2410.07554
Database: arXiv
More Details
Description not available.