arrow
Return

Exploratory machine learning with unknown unknowns

delete2024-02-01
delete2
delete
OA
AI
P
Peng Zhao
J
Jia-Wei Shan
Y
Yujie Zhang
Zhi-Hua Zhou cover
Zhi-Hua Zhou (Zhi‐Hua Zhou) *
DOI:10.1016/j.artint.2023.104059delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In conventional supervised learning, a training dataset is given with ground -truth labels from a known label set, and the learned model will classify unseen instances to known labels. This paper studies a new problem setting in which there are unknown classes in the training data misperceived as other labels, and thus their existence appears unknown from the given supervision. We attribute the unknown unknowns to the fact that the training dataset is badly advised by the incompletely perceived label space due to the insufficient feature information. To this end, we propose the exploratory machine learning, which examines and investigates training data by actively augmenting the feature space to discover potentially hidden classes. Our method consists of three ingredients including rejection model, feature exploration, and model cascade. We provide theoretical analysis to justify its superiority, and validate the effectiveness on both synthetic and real datasets.
Keywords:
Exploratory machine learning
Unknown unknowns
Robust AI
Robustness
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Artificial Intelligence Review cover
Artificial Intelligence Review
IF:
13.9
Papers:
6.1K
Citations:
1.9W

Organization

N
nanjing university
Scholars:
7.8W
Papers: 5.6W
Citations: 87
Cited Papers

Cited Papers

Improving classification performance through selective instance completion
err2015-07-14
err8
errOAAI
errDhurandhar, Amit; Sankaranarayanan, Karthik
errShare
errSave
A Survey on Concept Drift Adaptation
err2014-03-01
err2.0K
errOAAI
errGama, Joao; Zliobaite, Indre; Bifet, Albert; Pechenizkiy, Mykola; Bouchachia, Abdelhamid
errShare
errSave
Observing the unexpected enhances infants' learning and exploration
errSCIENCE
IF45.8
err2015-04-03
err373
errOAAI
errStahl, Aimee E.; Feigenson, Lisa
errShare
errSave
Zeolites as catalysts in oil refining
err2014-03-27
err0
PREAI
errAna Primo; Hermenegildo Garcia
errShare
errSave
Bagging predictors
err1996-08-01
err1.0W
PREAI
errBreiman, L
errShare
errSave
A Survey on Transfer Learning
err2010-10-01
err1.4W
PREAI
errPan, Sinno Jialin; Yang, Qiang
errShare
errSave
researcher View more