arrow
Return

Large Deviation Algorithms for Thresholding Bandit Problem

delete2025-10-01
delete0
PRE
AI
G
Guangwu Liu
D
Dai Shan *
J
Jiaqi Chen
P
Philippe Fournier‐Viger
DOI:10.26599/BDMA.2025.9020028delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The Thresholding Bandit (TB) problem is a popular sequential decision-making problem, which aims at identifying the systems whose means are greater than a threshold. Instead of working on the upper bound of a loss function, our approach stands out from conventional practices by directly minimizing the loss itself. Leveraging the large deviation theory, we firstly provide an asymptotically optimal allocation rule for the TB problem, and then propose a parameter-free Large Deviation (LD) algorithm to make the allocation rule implementable. Central limit theorem-based Large Deviation (CLD) algorithm is further proposed as a supplement to improve the computation efficiency using normal approximation. Extensive experiments are conducted to validate the superiority of our algorithms compared to existing methods, and demonstrate their broader applications to more general distributions and various kinds of loss functions.
Keywords:
Upper bound
Decision making
Big Data
Approximation algorithms
Computational efficiency
Resource management
Data mining
Thresholding Bandit (TB) problem
Large Deviation (LD) theory
optimal allocation rule
parameter-free policy
asymptotical optimality

Journal

Big Data Mining and Analytics cover
Big Data Mining and Analytics
IF:
6.2
Papers:
274
Citations:
1.0K

Organization

S
Shenzhen University
Scholars:
4.0K
Papers: 1.7K
Citations: 5.4W
S
Shenzhen Research Institute of Big Data
Scholars:
251
Papers: 349
Citations: 357
C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
G
guangming laboratory
Scholars:
267
Papers: 199
Citations: 0
researcher View more organizations