arrow
Return

Learning task-oriented grasping for tool manipulation from simulated self-supervision

delete2019-08-29
delete114
delete
OA
AI
K
Kuan Fang *
Y
Yuke Zhu
A
Animesh Garg
A
Andrey Kurenkov
V
Viraj Mehta
L
Li Fei-Fei
S
Silvio Savarese
DOI:10.1177/0278364919872545delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Tool manipulation is vital for facilitating robots to complete challenging task goals. It requires reasoning about the desired effect of the task and, thus, properly grasping and manipulating the tool to achieve the task. Most work in robotics has focused on task-agnostic grasping, which optimizes for only grasp robustness without considering the subsequent manipulation tasks. In this article, we propose the Task-Oriented Grasping Network (TOG-Net) to jointly optimize both task-oriented grasping of a tool and the manipulation policy for that tool. The training process of the model is based on large-scale simulated self-supervision with procedurally generated tool objects. We perform both simulated and real-world experiments on two tool-based manipulation tasks: sweeping and hammering. Our model achieves overall 71.1% task success rate for sweeping and 80.0% task success rate for hammering.
Keywords:
Grasping
manipulation
learning and adaptive systems
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Robotics Research cover
International Journal of Robotics Research
IF:
5
Papers:
2.4K
Citations:
1.5W

Organization

S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W