arrow
Return

Optimistic Sampling Strategy for Data-Efficient Reinforcement Learning

delete2019-01-01
delete2
delete
OA
AI
D
Dongfang Zhao
J
Jiafeng Liu
吴
吴锐 (Rui Wu) *
D
Dansong Cheng
DOI:10.1109/ACCESS.2019.2913001delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A high required number of interactions with the environment is one of the most important problems in reinforcement learning (RL). To deal with this problem, several data-efficient RL algorithms have been proposed and successfully applied in practice. Unlike previous research, that focuses on optimal policy evaluation and policy improvement stages, we actively select informative samples by leveraging entropy-based optimal sampling strategy, which takes the initial samples set into consideration. During the initial sampling process, information entropy is used to describe the potential samples. The agent selects the most informative samples using an optimization method. This way, the initial sample is more informative than in random and fixed strategy. Therefore, a more accurate initial dynamic model and policy can be learned. Thus, the proposed optimal sampling method guides the agent to search in a more informative region. The experimental results on standard benchmark problems involving a pendulum, cart pole, and cart double pendulum show that our optimal sampling strategy has a better performance in terms of data efficiency.
Keywords:
Reinforcement learning
information entropy
optimistic sampling
data efficiency
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
Cited Papers

Cited Papers

A recurrent neural network for classification of unevenly sampled variable stars
err2017-11-27
err115
errOAAI
errNaul, Brett; Bloom, Joshua S.; Perez, Fernando; van der Walt, Stefan
errShare
errSave
Optimization of in vitro expansion of human multipotent mesenchymal stromal cells for cell‐therapy approaches: Further insights in the search for a fetal calf serum substitute
err2006-12-22
err0
PREAI
errM.E. Bernardo; M.A. Avanzini; C. Perotti; A.M. Cometa; A. Moretta; E. Lenta; C. Del Fante; F. Novara; A. de Silvestri; G. Amendola; O. Zuffardi; R. Maccario; F. Locatelli
errShare
errSave
Discovery of Antiamebic Compounds That Inhibit Cysteine Synthase From the Enteric Parasitic Protist Entamoeba histolytica by Screening of Microbial Secondary Metabolites
err2018-12-05
err0
errOAAI
errMihoko Mori; Satoshi Tsuge; Wataru Fukasawa; Ghulam Jeelani; Kumiko Nakada-Tsukui; Kenichi Nonaka; Atsuko Matsumoto; Satoshi Ōmura; Tomoyoshi Nozaki; Kazuro Shiomi
errShare
errSave
errShare
errSave
no more