.png){kind=icon}
返回
Nuclear discrepancy for single-shot batch active learning
.png){kind=icon}
OA
AI
DOI：10.1007/s10994-019-05817-y.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Active learning algorithms propose what data should be labeled given a pool of unlabeled data. Instead of selecting randomly what data to annotate, active learning strategies aim to select data so as to get a good predictive model with as little labeled samples as possible. Single-shot batch active learners select all samples to be labeled in a single step, before any labels are observed. We study single-shot active learners that minimize generalization bounds to select a representative sample, such as the maximum mean discrepancy (MMD) active learner. We prove that a related bound, the discrepancy, provides a tighter worst-case bound. We study these bounds probabilistically, which inspires us to introduce a novel bound, the nuclear discrepancy (ND). The ND bound is tighter for the expected loss under optimistic probabilistic assumptions. Our experiments show that the MMD active learner performs better than the discrepancy in terms of the mean squared error, indicating that tighter worst case bounds do not imply better active learning performance. The proposed active learner improves significantly upon the MMD and discrepancy in the realizable setting and a similar trend is observed in the agnostic setting, showing the benefits of a probabilistic approach to active learning. Our study highlights that assumptions underlying generalization bounds can be equally important as bound-tightness, when it comes to active learning performance. Code for reproducing our experimental results can be found at https://github.com/tomviering/NuclearDiscrepancy.
Keyword:
Active learning
Maximum mean discrepancy
Discrepancy
Kernel methods
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.9
论文数:
2.7K
被引数:
3.4W
机构
引用论文
Performance of Selected Herbaceous Annual Ornamentals Grown at Decreasing Levels of Irrigation在灌溉水平降低的情况下生长的某些草本一年生观赏植物的性能.png)
HortScience
OAAI
HortScienceIF0
OAAI分享收藏Fast exact leave-one-out cross-validation of sparse least-squares support vector machines稀疏最小二乘支持向量机的快速精确留一交叉验证NEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏Exploring Sequence Characteristics Related to High-Level Production of Secreted Proteins in Aspergillus nigerPLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏
查看更多内容