arrow
Return

Learning From Sparse Demonstrations

delete2023-02-01
delete11
delete
OA
AI
W
Wanxin Jin *
T
Todd D. Murphey
D
Dana Kulić
N
Neta Ezer
S
Shaoshuai Mou
DOI:10.1109/TRO.2022.3191592delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, we develop the method of continuous Pontryagin differentiable programming (Continuous PDP), which enables a robot to learn an objective function from a few sparsely demonstrated keyframes. The keyframes, labeled with some time stamps, are the desired task-space outputs, which a robot is expected to follow sequentially. The time stamps of the keyframes can be different from the time of the robot's actual execution. The method jointly finds an objective function and a time-warping function such that the robot's resulting trajectory sequentially follows the keyframes with minimal discrepancy loss. The Continuous PDP minimizes the discrepancy loss using projected gradient descent by efficiently solving the gradient of the robot trajectory with respect to the unknown parameters. The method is first evaluated on a simulated robot arm and then applied to a 6-DoF quadrotor to learn an objective function for motion planning in unmodeled environments. The results show the efficiency of the method, its ability to handle time misalignment between keyframes and robot execution, and the generalization of objective learning into unseen motion conditions.
Keywords:
Robots
Trajectory
Linear programming
Task analysis
Optimal control
Costs
Cost function
Inverse optimal control (IOC)
inverse reinforcement learning (IRL)
learning from demonstrations (LfD)
motion planning
optimal control
Pontryagin differentiable programming (PDP)

Journal

IEEE Transactions on Robotics cover
IEEE Transactions on Robotics
IF:
10.5
Papers:
3.3K
Citations:
2.8W

Organization

M
Monash University
Scholars:
5.4W
Papers: 5.4W
Citations: 79
U
university of pennsylvania
Scholars:
9.2W
Papers: 7.8W
Citations: 153
N
northrop grumman corporation
Scholars:
302
Papers: 164
Citations: 0
Purdue University System cover
Purdue University System
Scholars:
4.0W
Papers: 3.6W
Citations: 66
N
Northwestern University
Scholars:
6.2W
Papers: 5.3W
Citations: 3.9K
researcher View more organizations
Cited Papers

Cited Papers

Center volume and primary graft dysfunction in patients undergoing lung transplantation in the United States – a cohort study
err2020-11-28
err0
PREAI
errOliver K. Jawitz; Vignesh Raman; Benjamin S. Bryner; Jacob Klapper; Matthew G. Hartwig
errShare
errSave
Heart rate variability in pheochromocytoma
err1995-12-01
err0
PREAI
errBarbara Dabrowska; Andrzej Dabrowski; Piotr Pruszczyk; Andrzej Skrobowski; Bozenna Wocial
errShare
errSave
Mental health among younger and older caregivers of dementia patients
err2016-03-10
err0
PREAI
errAsuka Koyama; Masateru Matsushita; Mamoru Hashimoto; Noboru Fujise; Tomohisa Ishikawa; Hibiki Tanaka; Yutaka Hatada; Yusuke Miyagawa; Maki Hotta; Manabu Ikeda
errShare
errSave
Medication Adherence and Associated Hemoglobin A1c in Type 2 Diabetes
err2004-09-01
err0
PREAI
errKimberley Krapek; Kathleen King; Susan S Warren; Karen G George; Dorothy A Caputo; Karen Mihelich; Elizabeth M Holst; Michael B Nichol; Sheng G Shi; Kevin B Livengood; Steve Walden; Teresa J Lubowski
errShare
errSave
Recent Advances in Robot Learning from Demonstration
err2020-05-03
err398
errOAAI
errRavichandar, Harish; Polydoros, Athanasios S.; Chernova, Sonia; Billard, Aude
errShare
errSave
Major element chemistry, weathering and element yields for the Caura River drainage, Venezuela
err1987-06-01
err0
PREAI
errWilliam M. Lewis; Stephen K. Hamilton; Sandra L. Jones; Donald D. Runnels
errShare
errSave
researcher View more