arrow
Return

A Policy Searched-Based Optimization Algorithm for Obstacle Avoidance in Robot Manipulators

delete2024-09-01
delete2
PRE
AI
A
Andong Liu *
J
Jiayun Fu
S
Shuwen Zhan
Z
Zhehao Jin
W
Wen‐An Zhang
DOI:10.1109/TIE.2023.3344831delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most current learning from demonstration algorithms are only applied in static work environments. However, using the learned skills directly in a changing environment may lead to unpredictable situations, such as collisions. Therefore, robots not only need to learn skill models from demonstrations but also need to generalize skills in response to the changing environment. This article proposes an relative entropy policy search-based obstacle avoidance algorithm, which naturally incorporates skill demonstration into an optimization problem that minimizes the difference between the optimal trajectory distribution and the demonstration distribution while avoiding obstacles. By imposing upper bound constraints on policy deviation in the optimization problem, the problems of policy jump and policy nonconvergence during policy update are solved. Since the optimization process is done offline, no gradient information is required, which allows the algorithm to avoid the complexities of online gradient computation. Finally, according to the optimal trajectory distribution, the kernelized movement primitive algorithm is used to encode skills, and combined with other task requirements to further achieve skill generalization. The simulation on the LASA dataset and robot obstacle avoidance experiment validate the effectiveness of the proposed method.
Keywords:
Collision avoidance
Trajectory
Robots
Optimization
Covariance matrices
Linear programming
Heuristic algorithms
Demonstration learning
obstacle avoidance
policy search
skill generalization

Journal

IEEE Transactions on Industrial Electronics cover
IEEE Transactions on Industrial Electronics
IF:
7.2
Papers:
1.8W
Citations:
9.8W

Organization

Z
zhejiang university of technology
Scholars:
3.3W
Papers: 2.0W
Citations: 22
Cited Papers

Cited Papers

errShare
errSave
Hypertension, pregnancy and weather: is seasonality involved?
err2014-01-01
err0
errOAAI
errBrena Melo; Melania Amorim; Leila Katz; Isabela Coutinho; José Natal Figueiroa
errShare
errSave
Gaussian process movement primitive
err2023-09-01
err6
PREAI
errJin, Zhehao; Liu, Andong; Zhang, Wen-an; Yu, Li; Yang, Chenguang
errShare
errSave
What Is the Relationship of Fear Avoidance to Physical Function and Pain Intensity in Injured Athletes?
err2018-02-16
err0
errOAAI
errStefan F. Fischerauer; Mojtaba Talaei-Khoei; Rens Bexkens; David C. Ring; Luke S. Oh; Ana-Maria Vranceanu
errShare
errSave
549 Perfusion/Decellularization of Large Animal Lungs
err2011-04-01
err0
PREAI
errG. Singh; J. Javidfar; J. Costa; J.V. Guarrera; J. Miller; S. Henry; Q. Jallerat; D.O. Freytes; G. Vunjak-Novakovic; J.R. Sonett; M.D. Bacchetta
errShare
errSave
errShare
errSave
Learning from Demonstration Based on a Classification of Task Parameters and Trajectory Optimization
err2019-12-10
err7
PREAI
errVidakovic, Josip; Jerbic, Bojan; Sekoranja, Bojan; Svaco, Marko; Suligoj, Filip
errShare
errSave
researcher View more