arrow
Return

Efficient quantile tracking using an oracle

delete2022-04-14
delete0
delete
OA
AI
H
Hugo L. Hammer *
A
Anis Yazidi
M
Michael A. Riegler
F
Finn Lindgren
DOI:10.1007/s10489-022-03489-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Concept drift is a well-known issue that arises when working with data streams. In this paper, we present a procedure that allows a quantile tracking procedure to cope with concept drift. We suggest using expected quantile loss, a popular loss function in quantile regression, to monitor the quantile tracking error, which, in turn, is used to efficiently adapt to concept drift. The suggested procedures adapt efficiently to concept drift, and the tracking performance is close to theoretically optimal. The procedures were further applied to three real-life streaming data sets related to Twitter event detection, activity recognition, and stock trading. The results show that the procedures are efficient at adapting to concept drift, thereby documenting the real-world applicability of the procedures. We further used asymptotic theory from statistics to show the appealing theoretical property that, if the data stream distribution is stationary over time, the procedures converge to the true quantile.
Keywords:
Concept drift
Data mining
Incremental quantile estimator
Real-time tracking

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

O
oslo metropolitan university (oslomet)
Scholars:
2.4K
Papers: 2.3K
Citations: 3
U
uit the arctic university of tromso
Scholars:
9.9K
Papers: 8.7K
Citations: 10
Cited Papers

Cited Papers

errShare
errSave
An Acetate‐Functionalized Tetranuclear Zirconium Sandwiching Polyoxometalate Complex
err2010-07-27
err0
PREAI
errWei Zhang; Shu‐Xia Liu; Chun‐Dan Zhang; Rui‐Kang Tan; Feng‐Ji Ma; Shu‐Jun Li; Yuan‐Yuan Zhang
errShare
errSave
Models of Inflammatory Breast Cancer
err2012-03-06
err0
PREAI
errLara Lacerda; Wendy A. Woodward
errShare
errSave
Digital Logistics Approach to Energy Service Socio-economic Mechanisms
err2021-01-01
err0
errOAAI
errSergey Barykin; Irina Kapustina; Olga Kalinina; Nelly Kozlova; Elena Ivanova; Ksenia Borodina; Vladimir Yadykin
errShare
errSave
Estimating Tukey depth using incremental quantile estimators
err2022-02-01
err4
errOAAI
errHammer, Hugo L.; Yazidi, Anis; Rue, Havard
errShare
errSave
researcher View more