arrow
Return

Explicit-to-Implicit Robot Imitation Learning by Exploring Visual Content Change

delete2022-12-01
delete8
PRE
AI
杨硕 cover
杨硕 (Shuo Yang)
W
Wei Zhang *
宋燃 cover
宋燃 (Ran Song)
W
Weizhi Lu
H
Hesheng Wang
李沂滨 (Yibin Li)
DOI:10.1109/TMECH.2022.3166993delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Demonstration understanding is the vital component for robot imitation learning. In this work, we investigate the visual change-based representation of the demonstration and build imitation learning pipelines in both explicit and implicit ways. Specifically, we first propose to represent the demonstration video via the visual change map and utilize it to generate explicit commands for robot execution. To pursue a more humanlike imitation learning pipeline, an implicit method is presented by extending the visual change-based representation from image level to feature level. Extensive experiments are conducted to evaluate the proposed methods and the results show that the proposed visual change-based approaches achieve the state-of-the-art imitation learning performance. Also, the results indicate the superiority of the implicit method over the explicit one for imitation learning. Supplementary video is available at https://vsislab.github.io/explicit2implicit/.
Keywords:
Deep learning
imitation learning
learning from demonstration
robot grasping

Journal

I
IEEE-ASME Transactions on Mechatronics
IF:
7.3
Papers:
5.4K
Citations:
2.4W

Organization

S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159
S
shandong university
Scholars:
9.4W
Papers: 6.4W
Citations: 94