arrow
Return

A variance maximization criterion for active learning

delete2018-06-01
delete43
delete
OA
AI
Y
Yazhou Yang *
M
Marco Loog
DOI:10.1016/j.patcog.2018.01.017delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Active learning aims to train a classifier as fast as possible with as few labels as possible. The core element in virtually any active learning strategy is the criterion that measures the usefulness of the unlabeled data based on which new points to be labeled are picked. We propose a novel approach which we refer to as maximizing variance for active learning or MVAL for short. MVAL measures the value of unlabeled instances by evaluating the rate of change of output variables caused by changes in the next sample to be queried and its potential labelling. In a sense, this criterion measures how unstable the classifier's output is for the unlabeled data points under perturbations of the training data. MVAL maintains, what we refer to as, retraining information matrices to keep track of these output scores and exploits two kinds of variance to measure the informativeness and representativeness, respectively. By fusing these variances, MVAL is able to select the instances which are both informative and representative. We employ our technique both in combination with logistic regression and support vector machines and demonstrate that MVAL achieves state-of-the-art performance in experiments on a large number of standard benchmark datasets. (C) 2018 Elsevier Ltd. All rights reserved.
Keywords:
Active learning
Retraining information matrix
Variance maximization

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.4W
Citations:
4.5W

Organization

D
Delft University of Technology
Scholars:
2.6W
Papers: 2.5W
Citations: 3.8W
Cited Papers

Cited Papers

Inconsistency-based active learning for support vector machines
err2012-10-01
err33
PREAI
errWang, Ran; Kwong, Sam; Chen, Degang
errShare
errSave
Active learning for logistic regression: an evaluation
err2007-08-04
err222
errOAAI
errSchein, Andrew I.; Ungar, Lyle H.
errShare
errSave
Active learning with adaptive regularization
err2011-10-01
err30
PREAI
errWang, Zheng; Yan, Shuicheng; Zhang, Changshui
errShare
errSave
Robust active learning for the diagnosis of parasites
err2015-11-01
err32
PREAI
errSaito, Priscila T. M.; Suzuki, Celso T. N.; Gomes, Jancarlo F.; de Rezende, Pedro J.; Falcao, Alexandre X.
errShare
errSave
Hessian optimal design for image retrieval
err2011-06-01
err11
PREAI
errLu, Ke; Zhao, Jidong; Wu, Yue
errShare
errSave
Visual deficits and cognitive assessment of multiple sclerosis: confounder, correlate, or both?
err2021-02-15
err0
PREAI
errDejan Jakimovski; Ralph H. B. Benedict; Bianca Weinstock-Guttman; Osman Ozel; Tom A. Fuchs; Norah Lincoff; Niels Bergsland; Michael G. Dwyer; Robert Zivadinov
errShare
errSave
Active sampling for class probability estimation and ranking
err2004-02-01
err102
errOAAI
errSaar-Tsechansky, M; Provost, F
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
SVM-based active feedback in image retrieval using clustering and unlabeled data
err2008-08-01
err65
PREAI
errLiu, Rujie; Wang, Yuehong; Baba, Takayuki; Masumoto, Daiki; Nagata, Shigemi
errShare
errSave
researcher View more