Back to Search Start Over

Twisting Lids Off with Two Hands

Authors :
Lin, Toru
Yin, Zhao-Heng
Qi, Haozhi
Abbeel, Pieter
Malik, Jitendra
Publication Year :
2024

Abstract

Manipulating objects with two multi-fingered hands has been a long-standing challenge in robotics, due to the contact-rich nature of many manipulation tasks and the complexity inherent in coordinating a high-dimensional bimanual system. In this work, we share novel insights into physical modeling, real-time perception, and reward design that enable policies trained in simulation using deep reinforcement learning (RL) to be effectively and efficiently transferred to the real world. Specifically, we consider the problem of twisting lids of various bottle-like objects with two hands, demonstrating policies with generalization capabilities across a diverse set of unseen objects as well as dynamic and dexterous behaviors. To the best of our knowledge, this is the first sim-to-real RL system that enables such capabilities on bimanual multi-fingered hands.<br />Comment: Project page can be found at https://toruowo.github.io/bimanual-twist

Details

Database :
arXiv
Publication Type :
Report
Accession number :
edsarx.2403.02338
Document Type :
Working Paper