arrow
返回

Multitask Augmented Random Search in deep reinforcement learning

delete2024-07-01
delete2
PRE
AI
L
Le Tien Thanh
T
Ta Bao Thang
L
Le Van Cuong
H
Huỳnh Thị Thanh Bình *
DOI:10.1016/j.asoc.2024.111605delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reinforcement Learning (RL) has gained significant popularity in recent years for its ability to solve complex control problems. However, most existing RL algorithms are designed to train policies for each environment in isolation, limiting their applicability to real -world scenarios with many related environments. Recently, many multitask optimization algorithms have been proposed and successfully applied to a wide range of optimization problems. However, existing studies mainly focus on solving multiple continuous function benchmarks and overlook the potential of tailoring towards RL. In this paper, we propose a simple multitask optimization algorithm called Multitask Augmented Random Search (MARS) that trains multiple RL agents together and exploits the performance surplus from highly correlated tasks. MARS is a modification of the simple random search Augmented Random Search (ARS) algorithm, which has been shown to outperform complicated methods in solving continuous control MuJoCo environments such as Soft Actor -Critic (SAC), Proximal Policy Optimization (PPO), and Trusted Region Policy Optimization (TRPO). The experimental results also demonstrate that our proposed algorithm is more consistent in solving different instances of MuJoCo benchmark than ARS, Multifactorial Evolution Algorithm (MFEA), and Adaptive MFEA RL (AMFEARL) within the same number of training episodes.
Keyword:
Multifactorial evolutionary algorithm
Deep reinforcement learning
Augmented random search

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

G
graduate university for advanced studies - japan
学者数:
3.4K
论文数: 2.6K
被引数: 0
H
hanoi university of science & technology (hust)
学者数:
3.3K
论文数: 2.2K
被引数: 1
引用论文

引用论文

Evolutionary Many-Task Optimization Based on Multisource Knowledge Transfer
err2022-04-01
err51
PREAI
errLiang, Zhengping; Xu, Xiuju; Liu, Ling; Tu, Yaofeng; Zhu, Zexuan
err分享
err收藏
Avaliação da qualidade de vida, variáveis sociodemográficas e morbidades referidas de idosos no mercado de trabalho
err2019-01-01
err0
errOAAI
errThamires Alves Silva; Daniel Pereira Mansine; Itayane Nayra Santos; Aline Duarte Ferreira; Larissa Sapucaia Esteves; Marcos Lupercio Ramos; Weber Gutemberg Oliveira
err分享
err收藏
Half a Dozen Real-World Applications of Evolutionary Multitasking, and More
err2022-05-01
err66
errOAAI
errGupta, Abhishek; Zhou, Lei; Ong, Yew-Soon; Chen, Zefeng; Hou, Yaqing
err分享
err收藏
err分享
err收藏
Evolutionary Multitask Optimization: a Methodological Overview, Challenges, and Future Research Directions
err2022-04-12
err48
PREAI
errOsaba, Eneko; Del Ser, Javier; Martinez, Aritz D.; Hussain, Amir
err分享
err收藏
Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II
err2020-02-01
err257
errOAAI
errBali, Kavitesh Kumar; Ong, Yew Soon; Gupta, Abhishek; Tan, Puay Siew
err分享
err收藏
学者 查看更多内容