.png){kind=icon}
返回
K-VIL: Keypoints-Based Visual Imitation Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TRO.2023.3286074.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Visual imitation learning provides efficient and intuitive solutions for robotic systems to acquire novel manipulation skills. However, simultaneously learning geometric task constraints and control policies from visual inputs alone remains a challenging problem. In this article, we propose the keypoint-based visual imitation learning (K-VIL) approach that automatically extracts sparse, object-centric, and embodiment-independent task representations from a small number of human demonstration videos. The task representation is composed of keypoint-based geometric constraints on principal manifolds, their associated local frames, and the movement primitives that are then needed for the task execution. Our approach is capable of extracting such task representations from a single-demonstration video and of incrementally updating them when new demonstrations are available. To reproduce manipulation skills using the learned set of prioritized geometric constraints in novel scenes, we introduce a novel keypoint-based admittance controller. We evaluate our approach in several real-world applications, showcasing its ability to deal with cluttered scenes, viewpoint mismatch, new instances of categorical objects, and large object pose and shape variations. Our evaluation demonstrates the efficiency and robustness of our approach in both one-shot and few-shot imitation learning settings.
Keyword:
Learning from demonstration
learning of geometric constraints
manipulation planning
visual learning
期刊
IF:
10.5
论文数:
3.3K
被引数:
2.8W
机构
引用论文
Population pharmacokinetic analysisof lamivudine, stavudine and zidovudine in controlled HIV-infected patients on HAART拉米夫定，司他夫定和齐多夫定在HAART控制的HIV感染患者中的群体药代动力学分析
OAAI
OAAI分享收藏分享收藏分享收藏Tracking dynamic adjustments to decision making and performance monitoring processes in conflict tasks.png)
NeuroImageOAAI
NeuroImageIF0
OAAI分享收藏
查看更多内容