arrow
Return

Efficient quantile tracking using an oracle

delete2022-04-14
delete0
delete
OA
AI
H
Hugo L. Hammer *
A
Anis Yazidi
M
Michael A. Riegler
F
Finn Lindgren
DOI:10.1007/s10489-022-03489-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Concept drift is a well-known issue that arises when working with data streams. In this paper, we present a procedure that allows a quantile tracking procedure to cope with concept drift. We suggest using expected quantile loss, a popular loss function in quantile regression, to monitor the quantile tracking error, which, in turn, is used to efficiently adapt to concept drift. The suggested procedures adapt efficiently to concept drift, and the tracking performance is close to theoretically optimal. The procedures were further applied to three real-life streaming data sets related to Twitter event detection, activity recognition, and stock trading. The results show that the procedures are efficient at adapting to concept drift, thereby documenting the real-world applicability of the procedures. We further used asymptotic theory from statistics to show the appealing theoretical property that, if the data stream distribution is stationary over time, the procedures converge to the true quantile.
Keywords:
Concept drift
Data mining
Incremental quantile estimator
Real-time tracking

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.5K
Citations:
1.7W

Organization

O
oslo metropolitan university (oslomet)
Scholars:
2.4K
Papers: 2.3K
Citations: 3
U
uit the arctic university of tromso
Scholars:
9.8K
Papers: 8.6K
Citations: 10