arrow
Return

Online Learning for Data Streams With Incomplete Features and Labels

delete2024-09-01
delete0
PRE
AI
D
Dianlong You
H
Huigui Yan
J
Jiawei Xiao
Z
Zhen Chen
吴迪 cover
吴迪 (Di Wu) *
申利民 (Limin Shen)
X
Xindong Wu
DOI:10.1109/TKDE.2024.3374357delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Online learning is critical for handling complex data streams in Big Data-related applications. This study explores a new online learning problem where both the features and labels are incomplete. Such incompleteness poses a critical challenge in determining the latent relationship between incomplete features and labels. Unfortunately, existing online learning methods only consider a few cases of incomplete feature spaces, such as trapezoidal, evolvable, and capricious data streams, limiting their applicability to this problem. To bridge this gap, this study proposes a novel algorithm of Online Learning for Data Streams with Incomplete Features and Labels (OLIFL). OLIFL imposes no constraints on changing patterns of feature space and does not require all instances to be labeled with two-fold ideas. First, OLIFL explores the informativeness of individual features to update the classifier by dynamically maintaining global feature space and updating the informativeness matrix. Second, it estimates the label confidence of unlabeled instances to control their negative effects by limiting the error upper bound. Extensive experiments on benchmark datasets are conducted in five scenarios: three incomplete feature (trapezoidal, evolvable, and capricious) spaces, and two incomplete labels (only missing labels and missing both features and labels). In addition, we explore the sensitivity of the model to parameters, and its usability and response efficiency in handling concept drifts. The results show that OLIFL significantly outperforms its rivals. Moreover, we use OLIFL to classify a movie review task as real application verification.
Keywords:
Streams
Data models
Aerospace electronics
Classification algorithms
Predictive models
Heuristic algorithms
Usability
Online learning
data stream
incomplete feature space
incomplete labels

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
S
southwest university - china
Scholars:
2.6W
Papers: 1.9W
Citations: 21
Y
Yanshan University
Scholars:
1.7W
Papers: 1.1W
Citations: 1.3W
researcher View more organizations