arrow
Return

A robot operating system framework for using large language models in embodied AI

delete2026-03-16
delete0
PRE
AI
C
Christopher E. Mower *
Y
Yuhui Wan
H
Hongzhan Yu
A
Antoine Grosnit
J
Jonas Gonzalez-Billandon
M
Matthieu Zimmer
P
Puze Liu
D
Daniel Palenicek
D
Davide Tateo
J
Jan Peters
K
Kaixian Qu
M
Mike Zhang
A
Andrei Cramariuc
C
César Cadena
M
Marco Hutter
G
Guangjian Tian
Y
Yuzhen Zhuang
K
Kun Shao
X
Xingyue Quan
J
Jianye Hao
J
Jun Wang
H
Haitham Bou-Ammar
DOI:10.1038/s42256-026-01186-zdelete
deleteOriginal
deleteShare
deleteSave
View Preprint
Abstract

Abstract

En 中文
Autonomous robots capable of turning natural-language instructions into reliable physical actions remain a central challenge in artificial intelligence. Here we show that connecting a large language model agent to the robot operating system enables a versatile framework for embodied intelligence, and we release the complete implementation as freely available open-source code. The agent automatically translates large language model outputs into robot actions, supports interchangeable execution modes (inline code or behaviour trees), learns new atomic skills via imitation, and continually refines them through automated optimization and reflection from human or environmental feedback. Extensive experiments validate the framework, showcasing robustness, scalability and versatility in diverse scenarios and embodiments, including long-horizon tasks, tabletop rearrangements, dynamic task optimization and remote supervisory control. Moreover, all the results presented in this work were achieved by utilizing open-source pretrained large language models. Mower, Wan et al. introduce ROS-LLM, an open-source system that lets non-experts control robots with natural language, learn new skills from demonstrations and feedback, and automatically tune actions for reliable performance in real-world tasks.
Keywords:
Computer science
Information technology
Engineering
general
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Machine Intelligence cover
Nature Machine Intelligence
IF:
23.9
Papers:
1.3K
Citations:
1.5W

Organization

H
huawei
Scholars:
43
Papers: 15
Citations: 0
U
university college london
Scholars:
8.6K
Papers: 4.6K
Citations: 1
T
technical university of darmstadt
Scholars:
483
Papers: 200
Citations: 0
E
ETH Zurich
Scholars:
3.0W
Papers: 2.4W
Citations: 8.4W
researcher View more organizations