arrow
返回

Corruption-tolerant bandit learning

delete2018-08-29
delete33
delete
OA
AI
S
Sayash Kapoor
K
Kumar Kshitij Patel
P
Purushottam Kar *
DOI:10.1007/s10994-018-5758-5delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We present algorithms for solving multi-armed and linear-contextual bandit tasks in the face of adversarial corruptions in the arm responses. Traditional algorithms for solving these problems assume that nothing but mild, e.g., i.i.d. sub-Gaussian, noise disrupts an otherwise clean estimate of the utility of the arm. This assumption and the resulting approaches can fail catastrophically if there is an observant adversary that corrupts even a small fraction of the responses generated when arms are pulled. To rectify this, we propose algorithms that use recent advances in robust statistical estimation to perform arm selection in polynomial time. Our algorithms are easy to implement and vastly outperform several existing UCB and EXP-style algorithms for stochastic and adversarial multi-armed and linear-contextual bandit problems in wide variety of experimental settings. Our algorithms enjoy minimax-optimal regret bounds, as well as can tolerate an adversary that is allowed to corrupt upto a universally constant fraction of the arms pulled by the algorithm.
Keyword:
Robust learning
Online learning
Bandit algorithms
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

I
indian institute of technology system (iit system)
学者数:
9.5W
论文数: 9.9W
被引数: 93
引用论文

引用论文

err分享
err收藏
Mobile markerless augmented reality and its application in forensic medicine移动无标记增强现实技术及其在法医学中的应用
err2014-08-23
err0
PREAI
errThomas Kilgus; Eric Heim; Sven Haase; Sabine Prüfer; Michael Müller; Alexander Seitel; Markus Fangerau; Tamara Wiebe; Justin Iszatt; Heinz-Peter Schlemmer; Joachim Hornegger; Kathrin Yen; Lena Maier-Hein
err分享
err收藏
Birds Flush Early and Avoid the Rush: An Interspecific Study
err2015-03-23
err0
errOAAI
errDiogo S. M. Samia; Daniel T. Blumstein
err分享
err收藏
Release of substance‐P‐like immunoreactivity in dog paw lymph after scalding injury
err2008-12-08
err0
PREAI
errCARL‐EVERT JONSSON; ERNST BRODIN; CARL‐JOHAN DALSGAARD; ANDERS HAEGERSTRAND
err分享
err收藏
Vasodilatory effects of adenosine A2 receptor agonists CGS 21680 and CGS 22492 in human vasculature
err1992-10-01
err0
PREAI
errShah R. Makujina; Majd H. Sabouni; Satish Bhatia; Frank L. Douglas; S.Jamal Mustafa
err分享
err收藏
Molecular detection and characterization of Shigella spp. harboring extended-spectrum β-lactamase genes in children with diarrhea in northwest Iran
err2022-12-08
err0
errOAAI
errSahar Sabour; Amir Teimourpour; Jafar Mohammadshahi; Hadi Peeridogaheh; Roghayeh Teimourpour; Taher Azimi; Zahra Hosseinali
err分享
err收藏
学者 查看更多内容