arrow
Return

Optimistic Sampling Strategy for Data-Efficient Reinforcement Learning

delete2019-01-01
delete2
delete
OA
AI
D
Dongfang Zhao
J
Jiafeng Liu
吴锐 (Rui Wu) *
D
Dansong Cheng
DOI:10.1109/ACCESS.2019.2913001delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A high required number of interactions with the environment is one of the most important problems in reinforcement learning (RL). To deal with this problem, several data-efficient RL algorithms have been proposed and successfully applied in practice. Unlike previous research, that focuses on optimal policy evaluation and policy improvement stages, we actively select informative samples by leveraging entropy-based optimal sampling strategy, which takes the initial samples set into consideration. During the initial sampling process, information entropy is used to describe the potential samples. The agent selects the most informative samples using an optimization method. This way, the initial sample is more informative than in random and fixed strategy. Therefore, a more accurate initial dynamic model and policy can be learned. Thus, the proposed optimal sampling method guides the agent to search in a more informative region. The experimental results on standard benchmark problems involving a pendulum, cart pole, and cart double pendulum show that our optimal sampling strategy has a better performance in terms of data efficiency.
Keywords:
Reinforcement learning
information entropy
optimistic sampling
data efficiency
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66