arrow
返回

A knowledge-based task planning approach for robot multi-task manipulation

delete2023-07-18
delete1
delete
OA
AI
D
Deshuai Zheng
Y
Yan Jin
薛
薛涛 (Tao Xue)
Y
Yong Liu *
DOI:10.1007/s40747-023-01155-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Task planning is a crucial component in facilitating robot multi-task manipulations. Language-based task planning methods offer practicality in receiving commands from humans in real-life scenarios and require only low-cost labeled data. However, existing methods often rely on sequence models for planning, which primarily focus on mapping language to sequences of sub-tasks while neglecting the knowledge about tasks and objects. To overcome these limitations, we propose a knowledge based task planning approach called Recurrent Graph Convolutional Network (RGCN). It is devised with a novel structure that combined GCN (Kipf and Welling in International Conference on Learning Representations (ICLR), 2017) and LSTM (Hochreiter and chmidhuber in Neural Comput 9 (8): 1735-1780, 1997. https://doi.org/10.1162/neco.1997.9.8.1735) which enables it to leverage knowledge graph data and historical predictions. The experimental results demonstrate that our approach achieves the impressive task planning success rate of 95.7%, surpassing the best baseline method significantly, which achieves 78.7%. Furthermore, we evaluate the performance of multi-task manipulation across a specific set of 20 tasks within a simulated environment. Notably, RGCN combined with pre-trained primitive tasks exhibits the highest success rate compared with state-of-art multi-task learning methods. Our method is proven to be significant for language-conditioned task planning and is qualified for instructing robots for multi-task manipulation.
Keyword:
Robot multi-task manipulation
Deep learning
Task planning
Knowledge graph

期刊

Complex and Intelligent Systems 封面图
Complex and Intelligent Systems
IF:
4.6
论文数:
2.1K
被引数:
6.6K

机构

暂无机构信息
引用论文

引用论文

Mechanical Characterization of SRG Composites According to AC434
err2019-08-16
err0
PREAI
errDavide Campanini; Houman A. Hadad; Christian Carloni; Claudio Mazzotti; Antonio Nanni
err分享
err收藏
Variability in Phelan‐McDermid syndrome: The impact of the PNPLA3 p.I148M polymorphism
err2018-10-11
err0
PREAI
errLuigi Boccuto; Ludovico Abenavoli; Lauren Cascio; Sujata Srikanth; Barbara DuPont; Andrew R. Mitz; Roger Curtis Rogers; Katy Phelan
err分享
err收藏
Learning task-oriented grasping for tool manipulation from simulated self-supervision
err2019-08-29
err114
errOAAI
errKuan Fang; Zhu, Yuke; Garg, Animesh; Kurenkov, Andrey; Mehta, Viraj; Li Fei-Fei; Savarese, Silvio
err分享
err收藏
Molecular Subsets in the Gene Expression Signatures of Scleroderma Skin
err2008-07-16
err0
errOAAI
errAusra Milano; Sarah A. Pendergrass; Jennifer L. Sargent; Lacy K. George; Timothy H. McCalmont; M. Kari Connolly; Michael L. Whitfield
err分享
err收藏
学者 查看更多内容