arrow
Return

A Robust Approach for Continuous Interactive Actor-Critic Algorithms

delete2021-01-01
delete14
delete
OA
AI
C
Cristian Millán-Arias *
B
Bruno Fernandes
F
Francisco Cruz
R
Richard Dazeley
S
Sérgio Fernandes
DOI:10.1109/ACCESS.2021.3099071delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Reinforcement learning refers to a machine learning paradigm in which an agent interacts with the environment to learn how to perform a task. The characteristics of the environment may change over time or be affected by disturbances not controlled, avoiding the agent finding a proper policy. Some approaches attempt to address these problems, as interactive reinforcement learning, where an external entity helps the agent learn through advice. Other approaches, such as robust reinforcement learning, allow the agent to learn the task, acting in a disturbed environment. In this paper, we propose an approach that addresses interactive reinforcement learning problems in a dynamic environment, where advice provides information on the task and the dynamics of the environment. Thus, an agent learns a policy in a disturbed environment while receiving advice. We implement our approach in the dynamic version of the cart-pole balancing task and a simulated robotic arm dynamic environment to organize objects. Our results show that the proposed approach allows an agent to complete the task satisfactorily in a dynamic, continuous state-action domain. Moreover, experimental results suggest agents trained with our approach are less sensitive to changes in the characteristics of the environment than interactive reinforcement learning agents.
Keywords:
Reinforcement learning
Task analysis
Approximation algorithms
Trajectory optimization
Proposals
Organisms
Manipulators
Continuous interactive reinforcement learning
interactive robust reinforcement learning
reinforcement learning
robust reinforcement learning

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
universidade de pernambuco (upe)
Scholars:
2.1K
Papers: 1.2K
Citations: 3
D
Deakin University
Scholars:
2.0W
Papers: 2.1W
Citations: 2.8W
Cited Papers

Cited Papers

Improving interactive reinforcement learning: What makes a good teacher?
err2018-03-01
err25
errOAAI
errCruz, Francisco; Magg, Sven; Nagai, Yukie; Wermter, Stefan
errShare
errSave
errShare
errSave
Towards a wireless and fully-implantable ECoG system
err2013-06-01
err0
PREAI
errE. Tolstosheeva; J. Hoeffmann; J. Pistor; D. Rotermund; T. Schellenberg; D. Boll; T. Hertzberg; V. Gordillo-Gonzalez; S. Mandon; D. Peters-Drolshagen; M. Schneider; K. Pawelzik; A. Kreiter; S. Paul; W. Lang
errShare
errSave
Hierarchical Deep Reinforcement Learning for Continuous Action Control
err2018-11-01
err127
errOAAI
errYang, Zhaoyang; Merrick, Kathryn; Jin, Lianwen; Abbass, Hussein A.
errShare
errSave
Backfill Practices for Sublevel Stoping System
err2014-01-01
err0
PREAI
errMuhammad Zaka Emad; Isaac Vennes; Hani Mitri; Cecile Kelly
errShare
errSave
Safety of Early Pharmacological Thromboprophylaxis after Subarachnoid Hemorrhage
err2014-10-30
err0
errOAAI
errAirton Leonardo de Oliveira Manoel; David Turkel-Parrella; Menno Germans; Ekaterina Kouzmina; Priscila da Silva Almendra; Thomas Marotta; Julian Spears; Simon Abrahamson
errShare
errSave
researcher View more