arrow
返回

Automatic Temperature Parameter Tuning for Reinforcement Learning Using Path Integral Policy Improvement

delete2024-12-01
delete0
delete
OA
AI
H
Hiroyasu Nakano *
R
Ryo Ariizumi
T
Toru Asai
S
Shun‐ichi Azuma
DOI:10.1109/TNNLS.2023.3312857delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, we propose a novel variant of path integral policy improvement with covariance matrix adaptation(PI2-CMA), which is a reinforcement learning (RL) algorithm that aims to optimize a parameterized policy for the continuous behavior of robots. PI2-CMA has a hyperparameter called the temperature parameter, and its value is critical for performance; however, little research has been conducted on it and the existing method still contains a tunable parameter, which can be critical to performance. Therefore, tuning by trial and error is necessary in the existing method. Moreover, we show that there is a problem setting that cannot be learned by the existing method. The pro-posed method solves both problems by automatically adjusting the temperature parameter for each update. We confirmed the effectiveness of the proposed method using numerical tests.
Keyword:
Legged robot
policy improvement
reinforcement learning (RL)
robotics
snake robot

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

K
Kyoto University
学者数:
5.1W
论文数: 4.6W
被引数: 6.1W
N
Nagoya University
学者数:
3.3W
论文数: 2.5W
被引数: 2.6W
引用论文

引用论文

Natural Actor-Critic
err2008-03-01
err643
PREAI
errPeters, Jan; Schaal, Stefan
err分享
err收藏
A soft artificial muscle driven robot with reinforcement learning
err2018-09-28
err60
errOAAI
errYang, Tao; Xiao, Youhua; Zhang, Zhen; Liang, Yiming; Li, Guorui; Zhang, Mingqi; Li, Shijian; Wong, Tuck-Whye; Wang, Yong; Li, Tiefeng; Huang, Zhilong
err分享
err收藏
STEREOCHEMISTRY IN ANAESTHESIA
err2007-06-28
err0
PREAI
errDavid A. Sidebotham; Stephan A. Schug
err分享
err收藏
Path Integral Policy Improvement With Population Adaptation
err2022-01-01
err6
PREAI
errYamamoto, Kosuke; Ariizumi, Ryo; Hayakawa, Tomohiro; Matsuno, Fumitoshi
err分享
err收藏
学者 查看更多内容