arrow
返回

Diffusion policy: Visuomotor policy learning via action diffusion

delete2024-10-11
delete2
delete
OA
AI
C
Cheng Chi *
Z
Zhenjia Xu
S
Siyuan Feng
E
Eric Cousineau
B
Benjamin Burchfiel
R
Russ Tedrake
S
Shuran Song
DOI:10.1177/02783649241273668delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper introduces Diffusion Policy, a new way of generating robot behavior by representing a robot's visuomotor policy as a conditional denoising diffusion process. We benchmark Diffusion Policy across 15 different tasks from 4 different robot manipulation benchmarks and find that it consistently outperforms existing state-of-the-art robot learning methods with an average improvement of 46.9%. Diffusion Policy learns the gradient of the action-distribution score function and iteratively optimizes with respect to this gradient field during inference via a series of stochastic Langevin dynamics steps. We find that the diffusion formulation yields powerful advantages when used for robot policies, including gracefully handling multimodal action distributions, being suitable for high-dimensional action spaces, and exhibiting impressive training stability. To fully unlock the potential of diffusion models for visuomotor policy learning on physical robots, this paper presents a set of key technical contributions including the incorporation of receding horizon control, visual conditioning, and the time-series diffusion transformer. We hope this work will help motivate a new generation of policy learning techniques that are able to leverage the powerful generative modeling capabilities of diffusion models. Code, data, and training details are available (diffusion-policy.cs.columbia.edu).
Keyword:
Imitation learning
visuomotor policy
manipulation

期刊

International Journal of Robotics Research 封面图
International Journal of Robotics Research
IF:
5
论文数:
2.4K
被引数:
1.5W

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
T
toyota motor corporation
学者数:
1.3K
论文数: 1.3K
被引数: 2
引用论文

引用论文

err分享
err收藏
err分享
err收藏
GTI: Learning to Generalize across Long-Horizon Tasks from Human Demonstrations
err2020-07-12
err0
errOAAI
errAjay Mandlekar; Danfei Xu; Roberto Martín-Martín; Silvio Savarese; Li Fei-Fei
err分享
err收藏
Group Normalization
err2018-10-06
err0
PREAI
errYuxin Wu; Kaiming He
err分享
err收藏
Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation
err2018-05-01
err0
errOAAI
errTianhao Zhang; Zoe McCarthy; Owen Jow; Dennis Lee; Xi Chen; Ken Goldberg; Pieter Abbeel
err分享
err收藏
学者 查看更多内容