arrow
Return

Online transfer learning framework for label scarcity in evolving data streams

delete2025-10-31
delete0
PRE
AI
J
Jian Zhu
S
Sanmin Liu *
S
Subin Huang
张平 (Ping Zhang)
W
Wentao Yu
T
Tuyi Zhang
G
Guoyi Zhang
DOI:10.1007/s10618-025-01167-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Data stream classification is an important research direction in the field of data mining. In the early stages of the emergence of new concepts in data streams, the issue of label scarcity limits the effectiveness of supervised learning. Meanwhile, evolutionary phenomena in data streams significantly affect classification performance. To address the issue of label scarcity in evolving data streams, this paper proposes an online transfer learning framework, referred to as OTLF. To reduce the distribution discrepancy between the source domain and the initial target domain and enhance transferability, OTLF introduces a clustering-based data preprocessing method for the source domain. This method selects the source instances that are most similar to the target domain distribution by calculating similarity weights. To improve the adaptability of the model to data stream evolution and enhance transfer efficiency, OTLF first updates and maintains the source domain micro-clusters online to effectively capture concept drift. It then constructs a concept evolution detection module, which uses a buffer to store potential new class anomalies and employs an emerging class detection method to monitor the appearance of new classes. Comparative simulation experiments with other algorithms on different data streams show that OTLF is effective and stable in most cases. Furthermore, OTLF maintains a competitive advantage in terms of classification accuracy and other performance metrics.
Keywords:
Data stream classification
Label scarcity
Transfer learning
Concept drift
Concept evolution

Journal

Data Mining and Knowledge Discovery cover
Data Mining and Knowledge Discovery
IF:
4.3
Papers:
195
Citations:
6.0K

Organization

S
School of Computer and Information
Scholars:
48
Papers: 22
Citations: 0