arrow
返回

Semi-supervised batch active learning based on mutual information

delete2024-12-10
delete0
PRE
AI
X
Xia Ji *
W
Wang, Lingzhu
F
Fang, Xiaohao
DOI:10.1007/s10489-024-05962-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Active learning reduces the annotation cost of machine learning by selecting and querying informative unlabeled samples. Semi-supervised active learning methods can considerably utilize the regional information of unlabeled samples, and thus, more effectively select valuable samples. Existing semi-supervised batch active learning algorithms frequently exhibit poor robustness due to their high computational complexity, making handling large-scale datasets a difficult task. However, existing active learning algorithms based on high-performance semi-supervised learners adopt a single-sample selection mode, under which the model requires multiple rounds of iterative processes, significantly reducing the overall efficiency of the algorithm and affecting its practicality. To address these issues, we propose a new semi-supervised batch active learning algorithm called approximate error reduction based on mutual information (MIAER). First, we use hierarchical anchor graph regularization (HAGR) as the semi-supervised learner. HAGR exhibits good robustness and only involves a small-scale reduced Laplacian matrix in its optimization process, enabling rapid processing of large-scale datasets. Second, we propose a batch sampling strategy based on mutual information and error reduction in the sample selection stage. This strategy, which is based on hierarchical anchor graphs, first measures the uncertainty of samples by using approximate error reduction, considerably reducing computational overhead. Then, it uses mutual information to measure the diversity of samples in category space while removing redundant batch samples, preserving samples with high uncertainty as much as possible. Comparative experiments with several advanced active learning methods on a large number of datasets fully demonstrate the effectiveness and stability of MIAER.
Keyword:
Active learning
Mutual information
Semi-supervised
Batch mode

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

A
anhui university
学者数:
1.9W
论文数: 1.2W
被引数: 24
引用论文

引用论文

Integrated genetic and epigenetic analysis revealed heterogeneity of acute lymphoblastic leukemia in Down syndrome
err2019-09-10
err0
errOAAI
errYasuo Kubota; Kumiko Uryu; Tatsuya Ito; Masafumi Seki; Tomoko Kawai; Tomoya Isobe; Tadayuki Kumagai; Tsutomu Toki; Kenichi Yoshida; Hiromichi Suzuki; Keisuke Kataoka; Yuichi Shiraishi; Kenichi Chiba; Hiroko Tanaka; Kentaro Ohki; Nobutaka Kiyokawa; Jiro Kagawa; Satoru Miyano; Akira Oka; Yasuhide Hayashi; Seishi Ogawa; Kiminori Terui; Atsushi Sato; Kenichiro Hata; Etsuro Ito; Junko Takita
err分享
err收藏
Granular Multilabel Batch Active Learning With Pairwise Label Correlation
err2022-05-01
err21
PREAI
errZhang, Yuanjian; Zhao, Tianna; Miao, Duoqian; Pedrycz, Witold
err分享
err收藏
ladybird determines cell fate decisions during diversification of Drosophila somatic muscles
err1998-09-15
err0
PREAI
errTeresa Jagla; François Bellard; Yves Lutz; Guy Dretzen; Maria Bellard; Krzysztof Jagla
err分享
err收藏
err分享
err收藏
Active, continual fine tuning of convolutional neural networks for reducing annotation efforts
err2021-07-01
err32
errOAAI
errZhou, Zongwei; Shin, Jae Y.; Gurudu, Suryakanth R.; Gotway, Michael B.; Liang, Jianming
err分享
err收藏
学者 查看更多内容