Return
A robot operating system framework for using large language models in embodied AI
DOI:10.1038/s42256-026-01186-z.png)
Abstract
En 中文
Autonomous robots capable of turning natural-language instructions into reliable physical actions remain a central challenge in artificial intelligence. Here we show that connecting a large language model agent to the robot operating system enables a versatile framework for embodied intelligence, and we release the complete implementation as freely available open-source code. The agent automatically translates large language model outputs into robot actions, supports interchangeable execution modes (inline code or behaviour trees), learns new atomic skills via imitation, and continually refines them through automated optimization and reflection from human or environmental feedback. Extensive experiments validate the framework, showcasing robustness, scalability and versatility in diverse scenarios and embodiments, including long-horizon tasks, tabletop rearrangements, dynamic task optimization and remote supervisory control. Moreover, all the results presented in this work were achieved by utilizing open-source pretrained large language models. Mower, Wan et al. introduce ROS-LLM, an open-source system that lets non-experts control robots with natural language, learn new skills from demonstrations and feedback, and automatically tune actions for reliable performance in real-world tasks.
Keywords:
Computer science
Information technology
Engineering
general
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
23.9
Papers:
1.3K
Citations:
1.5W

