arrow
返回

DynaQ: online learning from imbalanced multi-class streams through dynamic sampling

delete2023-07-29
delete4
delete
OA
AI
F
Farnaz Sadeghi
H
Herna L. Viktor *
P
Parsa Vafaie
DOI:10.1007/s10489-023-04886-wdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Online supervised learning from fast-evolving data streams, particularly in domains such as health, the environment, and manufacturing, is a crucial research area. However, these domains often experience class imbalance, which can skew class distributions. It is essential for online learning algorithms to analyze large datasets in real-time while accurately modeling rare or infrequent classes that may appear in bursts. While methods have been proposed to handle binary class imbalance, there is a lack of attention to multi-class imbalanced settings with varying degrees of imbalance in evolving streams. In this paper, we present the Dynamic Queues (DynaQ) algorithm for online learning in multi-class imbalanced settings to fill this knowledge gap. Our approach utilizes a batch-based resampling method that creates an instance queue for each class to balance the number of instances. We maintain a queue threshold and remove older samples during training. Additionally, we dynamically oversample minority classes based on one of four rate parameters: recall, F1-score, ?m, and Euclidean distance. Our learning algorithm consists of an ensemble that uses sliding windows and a soft voting schema while incorporating a drift detection mechanism. Our experimental results demonstrate the superiority of the DynaQ approach over state-of-the-art methods.
Keyword:
Online learning
Multi-class imbalance
Data streams
Ensembles
Concept drift

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

U
University of Ottawa
学者数:
3.5W
论文数: 3.1W
被引数: 3.8W
引用论文

引用论文

err分享
err收藏
err分享
err收藏
A dummy-based user privacy protection approach for text information retrieval
err2020-05-01
err138
PREAI
errWu, Zongda; Shen, Shigen; Lian, Xinze; Su, Xinning; Chen, Enhong
err分享
err收藏
Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approaches
err2013-04-01
err301
PREAI
errFernandez, Alberto; Lopez, Victoria; Galar, Mikel; Jose del Jesus, Maria; Herrera, Francisco
err分享
err收藏
Irrigation and Greenhouse Gas Emissions: A Review of Field-Based Studies
err2020-04-13
err0
errOAAI
errAnish Sapkota; Amir Haghverdi; Claudia C. E. Avila; Samantha C. Ying
err分享
err收藏
学者 查看更多内容