.png){kind=icon}
Return
ToolBot: Learning Oriented Keypoints for Tool Usage From Self-Supervision
.png){kind=icon}
PRE
AI
DOI：10.1109/TII.2023.3271113.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Tool usage is critical for enabling robots to complete challenging tasks that exceed their innate capabilities. Task-oriented grasp and manipulation are two primitive actions in tool usage tasks. In this article, we present an end-to-end framework for jointly inferring two primitive actions through self-supervision, which can guide robots to complete tool usage tasks. We formulate primitive actions as oriented keypoint representations so that the existing pose-based policies can be easily used to achieve tool usage tasks. To address the low task completion rates in self-supervision, we propose a novel technique based on self-supervision properties and forward kinematic models to generate additional effective training samples. The resulting system, ToolBot, is evaluated with the following four different kinds of tools: hammer, knife, screwdriver, and wrench, and it achieves an average task success rate of 82.88% in simulation for four tools and 77.72% in real-world experiments.
Keywords:
Data-efficient robot learning
self-superv ision
tool usage
visuomotor policy
Journal
IF:
9.9
Papers:
8.6K
Citations:
6.0W
Organization
Cited Papers
ShareSaveShareSaveShareSaveShareSaveCryo-EM reveals structural breaks in a patient-derived amyloid fibril from systemic AL amyloidosis.png)
OAAI
IF0
OAAIShareSaveFabrication of TiO2 nanotube arrays and their application in flexible dye-sensitized solar cellsRSC Adv.
RSC Adv.IF0
PREAI
ShareSave
View more