arrow
返回

Stopping Criterion for Active Learning with Model Stability

delete2017-10-25
delete4
PRE
AI
W
Wenbin Cai
王
王文泉 (Wenquan Wang)
Y
Ya Zhang *
DOI:10.1145/3125645delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Active learning selectively labels the most informative instances, aiming to reduce the cost of data annotation. While much effort has been devoted to active sampling functions, relatively limited attention has been paid to when the learning process should stop. In this article, we focus on the stopping criterion of active learning and propose a model stability-based criterion, that is, when a model does not change with inclusion of additional training instances. The challenge lies in how to measure the model change without labeling additional instances and training new models. Inspired by the stochastic gradient update rule, we use the gradient of the loss function at each candidate example to measure its effect on model change. We propose to stop active learning when the model change brought by any of the remaining unlabeled examples is lower than a given threshold. We apply the proposed stopping criterion to two popular classifiers: logistic regression (LR) and support vector machines (SVMs). In addition, we theoretically analyze the stability and generalization ability of the model obtained by our stopping criterion. Substantial experiments on various UCI benchmark datasets and ImageNet datasets have demonstrated that the proposed approach is highly effective.
Keyword:
Active learning
logistic regression
model stability
stopping criterion
support vector machines
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Intelligent Systems and Technology 封面图
ACM Transactions on Intelligent Systems and Technology
IF:
6.6
论文数:
1.5K
被引数:
6.2K

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

Dendrochronologically dated changes in the limit of pine in northernmost Finland during the past 7.5 millennia
err2004-09-01
err0
PREAI
errSamuli Helama; Markus Lindholm; Mauri Timonen; Matti Eronen
err分享
err收藏
Active learning for logistic regression: an evaluation
err2007-08-04
err222
errOAAI
errSchein, Andrew I.; Ungar, Lyle H.
err分享
err收藏
Prey Capture and Competition in the Ant Lion
err1974-09-01
err0
PREAI
errDavid Sloan Wilson
err分享
err收藏
Molecular Signaling Mechanisms Underlying Epileptogenesis癫痫发生的分子信号机制
err2006-10-10
err0
PREAI
errJames O. McNamara; Yang Zhong Huang; A. Soren Leonard
err分享
err收藏
Visual deficits and cognitive assessment of multiple sclerosis: confounder, correlate, or both?多发性硬化症的视觉缺陷和认知评估: 混杂,相关,或两者兼而有之?
err2021-02-15
err0
PREAI
errDejan Jakimovski; Ralph H. B. Benedict; Bianca Weinstock-Guttman; Osman Ozel; Tom A. Fuchs; Norah Lincoff; Niels Bergsland; Michael G. Dwyer; Robert Zivadinov
err分享
err收藏
Stereotyped: Investigating Gender in Introductory Science Courses刻板印象: 在入门科学课程中调查性别
err2013-03-01
err0
errOAAI
errShanda Lauer; Jennifer Momsen; Erika Offerdahl; Mila Kryjevskaia; Warren Christensen; Lisa Montplaisir
err分享
err收藏
学者 查看更多内容