返回
Stopping Criterion for Active Learning with Model Stability
DOI:10.1145/3125645.png)
摘要
En 中文
Active learning selectively labels the most informative instances, aiming to reduce the cost of data annotation. While much effort has been devoted to active sampling functions, relatively limited attention has been paid to when the learning process should stop. In this article, we focus on the stopping criterion of active learning and propose a model stability-based criterion, that is, when a model does not change with inclusion of additional training instances. The challenge lies in how to measure the model change without labeling additional instances and training new models. Inspired by the stochastic gradient update rule, we use the gradient of the loss function at each candidate example to measure its effect on model change. We propose to stop active learning when the model change brought by any of the remaining unlabeled examples is lower than a given threshold. We apply the proposed stopping criterion to two popular classifiers: logistic regression (LR) and support vector machines (SVMs). In addition, we theoretically analyze the stability and generalization ability of the model obtained by our stopping criterion. Substantial experiments on various UCI benchmark datasets and ImageNet datasets have demonstrated that the proposed approach is highly effective.
Keyword:
Active learning
logistic regression
model stability
stopping criterion
support vector machines
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.6
论文数:
1.5K
被引数:
6.2K
机构
引用论文
Dendrochronologically dated changes in the limit of pine in northernmost Finland during the past 7.5 millennia
Boreas
IF0
Studies on Lupin Alkaloids. IV. Total Syntheses of Optically Active Matrine and Allomatrine羽扇豆生物碱的研究。四。光学活性苦参碱和Allomatrine的总合成
Visual deficits and cognitive assessment of multiple sclerosis: confounder, correlate, or both?多发性硬化症的视觉缺陷和认知评估: 混杂,相关,或两者兼而有之?

