Return
A Robust Approach for Continuous Interactive Actor-Critic Algorithms
DOI:10.1109/ACCESS.2021.3099071.png)
Abstract
En 中文
Reinforcement learning refers to a machine learning paradigm in which an agent interacts with the environment to learn how to perform a task. The characteristics of the environment may change over time or be affected by disturbances not controlled, avoiding the agent finding a proper policy. Some approaches attempt to address these problems, as interactive reinforcement learning, where an external entity helps the agent learn through advice. Other approaches, such as robust reinforcement learning, allow the agent to learn the task, acting in a disturbed environment. In this paper, we propose an approach that addresses interactive reinforcement learning problems in a dynamic environment, where advice provides information on the task and the dynamics of the environment. Thus, an agent learns a policy in a disturbed environment while receiving advice. We implement our approach in the dynamic version of the cart-pole balancing task and a simulated robotic arm dynamic environment to organize objects. Our results show that the proposed approach allows an agent to complete the task satisfactorily in a dynamic, continuous state-action domain. Moreover, experimental results suggest agents trained with our approach are less sensitive to changes in the characteristics of the environment than interactive reinforcement learning agents.
Keywords:
Reinforcement learning
Task analysis
Approximation algorithms
Trajectory optimization
Proposals
Organisms
Manipulators
Continuous interactive reinforcement learning
interactive robust reinforcement learning
reinforcement learning
robust reinforcement learning
Journal
IF:
3.6
Papers:
9.8W
Citations:
29.4W
Organization
Cited Papers
Real-time reinforcement learning by sequential Actor-Critics and experience replay
NEURAL NETWORKS
IF6.3

