arrow
返回

THE MULTI-ARMED BANDIT PROBLEM: AN EFFICIENT NONPARAMETRIC SOLUTION

delete2020-02-01
delete15
delete
OA
AI
C
Chan, Hock Peng *
DOI:10.1214/19-AOS1809delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Lai and Robbins (Adv. in Appl. Math. 6 (1985) 4-22) and Lai (Ann. Statist. 15 (1987) 1091-1114) provided efficient parametric solutions to the multi-armed bandit problem, showing that arm allocation via upper confidence bounds (UCB) achieves minimum regret. These bounds are constructed from the Kullback-Leibler information of the reward distributions, estimated from specified parametric families. In recent years, there has been renewed interest in the multi-armed bandit problem due to new applications in machine learning algorithms and data analytics. Nonparametric arm allocation procedures like epsilon-greedy, Boltzmann exploration and BESA were studied, and modified versions of the UCB procedure were also analyzed under nonparametric settings. However, unlike UCB these nonparametric procedures are not efficient under general parametric settings. In this paper, we propose efficient nonparametric procedures.
Keyword:
Efficiency
KL-UCB
subsampling
Thompson sampling
UCB

期刊

Annals of Statistics 封面图
Annals of Statistics
IF:
3.7
论文数:
2.8K
被引数:
2.9W

机构

N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

Signal-on fluorescent sensor based on GQDs–MnO2 composite for glutathione
err2016-01-01
err0
PREAI
errZongen Liu; Xiaohui Cai; Xuefang Lin; Yanjie Zheng; Yangting Wu; Pingping Chen; Shaohuang Weng; Liqing Lin; Xinhua Lin
err分享
err收藏
err分享
err收藏
Correction: Clinical Applicability and Cutoff Values for an Unstructured Neuropsychological Assessment Protocol for Older Adults with Low Formal Education
err2013-10-01
err0
errOAAI
errJonas Jardim de Paula; Laiss Bertola; Rafaela Teixeira Ávila; Lafaiete Moreira; Gabriel Coutinho; Edgar Nunes de Moraes; Maria Aparecida Camargos Bicalho; Rodrigo Nicolato; Breno Satler Diniz; Leandro Fernandes Malloy-Diniz
err分享
err收藏
Reuse of Waste Shells as a SO2/NOx Removal Sorbent
err2012-03-16
err0
errOAAI
errJong-Hyeon Jung; Jae-Jeong Lee; Gang-Woo Lee; Kyung-Seun Yoo; Byung-Hyun Sho
err分享
err收藏
KULLBACK-LEIBLER UPPER CONFIDENCE BOUNDS FOR OPTIMAL SEQUENTIAL ALLOCATION
err2013-06-01
err206
errOAAI
errCappe, Olivier; Garivier, Aurelien; Maillard, Odalric-Ambrym; Munos, Remi; Stoltz, Gilles
err分享
err收藏
Experimental Electrical Burns: Low Voltage
err1984-09-01
err0
PREAI
errLouise C. Laberge; Paul A. Ballard; Rollin K. Daniel
err分享
err收藏
err分享
err收藏
学者 查看更多内容