arrow
返回

PROGPROMPT: program generation for situated robot task planning using large language models

delete2023-08-28
delete14
delete
OA
AI
I
Ishika Singh *
V
Valts Blukis
A
Arsalan Mousavian
A
Ankit Goyal
D
Danfei Xu
J
Jonathan Tremblay
D
Dieter Fox
J
Jesse Thomason
A
Animesh Garg
DOI:10.1007/s10514-023-10135-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Task planning can require defining myriad domain knowledge about the world in which a robot needs to act. To ameliorate that effort, large language models (LLMs) can be used to score potential next actions during task planning, and even generate action sequences directly, given an instruction in natural language with no additional domain information. However, such methods either require enumerating all possible next steps for scoring, or generate free-form text that may contain actions not possible on a given robot in its current context. We present a programmatic LLM prompt structure that enables plan generation functional across situated environments, robot capabilities, and tasks. Our key insight is to prompt the LLM with program-like specifications of the available actions and objects in an environment, as well as with example programs that can be executed. We make concrete recommendations about prompt structure and generation constraints through ablation experiments, demonstrate state of the art success rates in VirtualHome household tasks, and deploy our method on a physical robot arm for tabletop tasks. Website and code at progprompt.github.io
Keyword:
Robot task planning
LLM code generation
Planning domain generalization
Symbolic planning

期刊

Autonomous Robots 封面图
Autonomous Robots
IF:
4.3
论文数:
1.7K
被引数:
5.0K

机构

U
university of southern california
学者数:
4.7W
论文数: 3.8W
被引数: 51
U
University of Washington
学者数:
8.0W
论文数: 7.0W
被引数: 12.5W
引用论文

引用论文

err分享
err收藏
Comprehensive optical losses investigation of VLSI Silicon optomechanical ring resonator sensors
err2018-12-01
err0
PREAI
errL. Schwab; P.E. Allain; L. Banniard; A. Fafin; M. Gely; O. Lemonnier; P. Grosse; M. Hermouet; S. Hentz; I. Favero; B. Legrand; G. Jourdan
err分享
err收藏
Acid catalysis in hydrolytic reactions水解反应中的酸催化
err1929-01-01
err0
PREAI
errJ. N. Brönsted; W. F. K. Wynne-Jones
err分享
err收藏
Les parakinésies. Phénoménologie des mouvements anormaux intrinsèques aux psychoses endogènes
err2022-06-01
err0
errOAAI
errJack René Foucher; Clément de Billy; Benoit Schorr; Laurent Vercueil; Alexandre Obrecht; Olivier Mainberger; Julie M.E. Clauss; Sébastien Weibel; Julien Elowe; Efflam Bregeon; Nelly Doligez; Ludovic C. Dormegny-Jeanjean; Fabrice Berna
err分享
err收藏
Longitudinal Cognitive Decline in Subcortical Ischemic Vascular Disease – The LADIS Study
err2009-03-10
err0
PREAI
errHanna Jokinen; Hely Kalska; Raija Ylikoski; Sofia Madureira; Ana Verdelho; Wiesje M. van der Flier; Philip Scheltens; Frederik Barkhof; Marieke C. Visser; Franz Fazekas; Reinhold Schmidt; John O’Brien; Gunhild Waldemar; Anders Wallin; Hugues Chabriat; Leonardo Pantoni; Domenico Inzitari; Timo Erkinjuntti
err分享
err收藏
err分享
err收藏
学者 查看更多内容