arrow
返回

Adaptive Optimization in Evolutionary Reinforcement Learning Using Evolutionary Mutation Rates

delete2024-01-01
delete0
delete
OA
AI
Y
Ying Zhao
Y
Yongsheng Ding
Y
Yan Pei *
DOI:10.1109/ACCESS.2024.3493198delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep reinforcement learning (DRL) has achieved notable success in continuous control tasks. However, it faces challenges that limit its applicability to a wider array of tasks, including sparse rewards and limited exploration. Recently, the integration of evolutionary algorithms (EAs) with deep reinforcement learning has emerged as a significant area of research. Evolutionary reinforcement learning (ERL) methods can help address specific challenges inherent in conventional reinforcement learning algorithms. However, the introduction of evolutionary computation algorithms increases the number of hyperparameters, and sensitivity to these hyperparameters continues to pose a significant challenge. This paper proposes an evolutionary reinforcement learning method incorporating evolutionary mutation rates. This method integrates a self-adaptive mutation rate mechanism into the ERL framework, which maintains two populations: one consisting of individuals (agents) and the other one comprising mutation rates. This represents our original contribution to this research. The actor population is categorized into several groups, each assigned a specific mutation rate. After mutation, the mutation rate of the population evolves based on the performance of the mutations within the actor population. This approach addresses the challenge of selecting mutation rates in ERL. Experimental results demonstrate superior performance compared to the standard ERL framework across six continuous control tasks.
Keyword:
Optimization
Standards
Evolutionary computation
Evolution (biology)
Heuristic algorithms
Deep reinforcement learning
Convergence
Sensitivity
Robustness
Neural networks
evolutionary computation algorithm
evolutionary reinforcement learning
self-adaptive mutation
optimization

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of Aizu
学者数:
768
论文数: 1.0K
被引数: 302
引用论文

引用论文

The pilot Stroke Data Bank: definition, design, and data.
err1984-07-01
err0
errOAAI
errS C Kunitz; C R Gross; A Heyman; C S Kase; J P Mohr; T R Price; P A Wolf
err分享
err收藏
Regional wave propagation in Turkey and surrounding regions
err2000-02-01
err0
errOAAI
errRengin Gök; Niyazi Türkelli; Eric Sandvol; Dogan Seber; Muawia Barazangi
err分享
err收藏
err分享
err收藏
Impact of the COVID-19 Pandemic on Melanoma Diagnosis: Increased Breslow Thickness in Primary Melanomas—A Single Center Experience
err2022-12-14
err0
errOAAI
errJelena Jeremić; Branko Suđecki; Kristina Radenović; Jovan Mihaljević; Ivan Radosavljević; Milan Jovanović; Nataša Milić; Vedrana Pavlović; Dimitrije Brašanac; Marko Jović
err分享
err收藏
学者 查看更多内容