.png){kind=icon}
返回
ToolBot: Learning Oriented Keypoints for Tool Usage From Self-Supervision
.png){kind=icon}
PRE
AI
DOI：10.1109/TII.2023.3271113.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Tool usage is critical for enabling robots to complete challenging tasks that exceed their innate capabilities. Task-oriented grasp and manipulation are two primitive actions in tool usage tasks. In this article, we present an end-to-end framework for jointly inferring two primitive actions through self-supervision, which can guide robots to complete tool usage tasks. We formulate primitive actions as oriented keypoint representations so that the existing pose-based policies can be easily used to achieve tool usage tasks. To address the low task completion rates in self-supervision, we propose a novel technique based on self-supervision properties and forward kinematic models to generate additional effective training samples. The resulting system, ToolBot, is evaluated with the following four different kinds of tools: hammer, knife, screwdriver, and wrench, and it achieves an average task success rate of 82.88% in simulation for four tools and 77.72% in real-world experiments.
Keyword:
Data-efficient robot learning
self-superv ision
tool usage
visuomotor policy
期刊
IF:
9.9
论文数:
8.5K
被引数:
6.0W
机构
引用论文
Population pharmacokinetic analysisof lamivudine, stavudine and zidovudine in controlled HIV-infected patients on HAART拉米夫定，司他夫定和齐多夫定在HAART控制的HIV感染患者中的群体药代动力学分析
OAAI
OAAI分享收藏分享收藏Cryo-EM reveals structural breaks in a patient-derived amyloid fibril from systemic AL amyloidosisCryo-em揭示了系统性AL淀粉样变性患者衍生的淀粉样蛋白原纤维的结构断裂.png)
OAAI
IF0
OAAI分享收藏Fabrication of TiO2 nanotube arrays and their application in flexible dye-sensitized solar cellsRSC Adv.
RSC Adv.IF0
PREAI
分享收藏
查看更多内容