arrow
Return

Semi-supervised active learning using convolutional auto- encoder and contrastive learning

delete2024-05-30
delete1
delete
OA
AI
H
Hezi Roda *
A
Amir B. Geva
DOI:10.3389/frai.2024.1398844delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Active learning is a field of machine learning that seeks to find the most efficient labels to annotate with a given budget, particularly in cases where obtaining labeled data is expensive or infeasible. This is becoming increasingly important with the growing success of learning-based methods, which often require large amounts of labeled data. Computer vision is one area where active learning has shown promise in tasks such as image classification, semantic segmentation, and object detection. In this research, we propose a pool-based semi-supervised active learning method for image classification that takes advantage of both labeled and unlabeled data. Many active learning approaches do not utilize unlabeled data, but we believe that incorporating these data can improve performance. To address this issue, our method involves several steps. First, we cluster the latent space of a pre-trained convolutional autoencoder. Then, we use a proposed clustering contrastive loss to strengthen the latent space's clustering while using a small amount of labeled data. Finally, we query the samples with the highest uncertainty to annotate with an oracle. We repeat this process until the end of the given budget. Our method is effective when the number of annotated samples is small, and we have validated its effectiveness through experiments on benchmark datasets. Our empirical results demonstrate the power of our method for image classification tasks in accuracy terms.
Keywords:
active learning
contrastive learning
clustering
semi-supervised learning
human-in-the-loop
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

F
Frontiers in Artificial Intelligence
IF:
4.7
Papers:
2.4K
Citations:
4.4K

Organization

B
ben gurion university
Scholars:
1.3W
Papers: 1.0W
Citations: 5
Cited Papers

Cited Papers

errShare
errSave
A Comparison of Systematic Screening Tools for Emotional and Behavioral Disorders
err2008-11-03
err0
PREAI
errKathleen Lynne Lane; M. Annette Little; Amy M. Casey; Warren Lambert; Joseph Wehby; Jessica L. Weisenbach; Andrea Phillips
errShare
errSave
errShare
errSave
A Survey of Deep Active Learning
err2021-10-08
err579
errOAAI
errRen, Pengzhen; Xiao, Yun; Chang, Xiaojun; Huang, Po-Yao; Li, Zhihui; Gupta, Brij B.; Chen, Xiaojiang; Wang, Xin
errShare
errSave
The complete genome sequence of the Gram-positive bacterium Bacillus subtilis
err1997-11-01
err0
errOAAI
errF. Kunst; N. Ogasawara; I. Moszer; A. M. Albertini; G. Alloni; V. Azevedo; M. G. Bertero; P. Bessières; A. Bolotin; S. Borchert; R. Borriss; L. Boursier; A. Brans; M. Braun; S. C. Brignell; S. Bron; S. Brouillet; C. V. Bruschi; B. Caldwell; V. Capuano; N. M. Carter; S.-K. Choi; J.-J. Codani; I. F. Connerton; N. J. Cummings; R. A. Daniel; F. Denizot; K. M. Devine; A. Düsterhöft; S. D. Ehrlich; P. T. Emmerson; K. D. Entian; J. Errington; C. Fabret; E. Ferrari; D. Foulger; C. Fritz; M. Fujita; Y. Fujita; S. Fuma; A. Galizzi; N. Galleron; S.-Y. Ghim; P. Glaser; A. Goffeau; E. J. Golightly; G. Grandi; G. Guiseppi; B. J. Guy; K. Haga; J. Haiech; C. R. Harwood; A. Hénaut; H. Hilbert; S. Holsappel; S. Hosono; M.-F. Hullo; M. Itaya; L. Jones; B. Joris; D. Karamata; Y. Kasahara; M. Klaerr-Blanchard; C. Klein; Y. Kobayashi; P. Koetter; G. Koningstein; S. Krogh; M. Kumano; K. Kurita; A. Lapidus; S. Lardinois; J. Lauber; V. Lazarevic; S.-M. Lee; A. Levine; H. Liu; S. Masuda; C. Mauël; C. Médigue; N. Medina; R. P. Mellado; M. Mizuno; D. Moestl; S. Nakai; M. Noback; D. Noone; M. O'Reilly; K. Ogawa; A. Ogiwara; B. Oudega; S.-H. Park; V. Parro; T. M. Pohl; D. Portetelle; S. Porwollik; A. M. Prescott; E. Presecan; P. Pujic; B. Purnelle; G. Rapoport; M. Rey; S. Reynolds; M. Rieger; C. Rivolta; E. Rocha; B. Roche; M. Rose; Y. Sadaie; T. Sato; E. Scanlan; S. Schleich; R. Schroeter; F. Scoffone; J. Sekiguchi; A. Sekowska; S. J. Seror; P. Serror; B.-S. Shin; B. Soldo; A. Sorokin; E. Tacconi; T. Takagi; H. Takahashi; K. Takemaru; M. Takeuchi; A. Tamakoshi; T. Tanaka; P. Terpstra; A. Tognoni; V. Tosato; S. Uchiyama; M. Vandenbol; F. Vannier; A. Vassarotti; A. Viari; R. Wambutt; E. Wedler; H. Wedler; T. Weitzenegger; P. Winters; A. Wipat; H. Yamamoto; K. Yamane; K. Yasumoto; K. Yata; K. Yoshida; H.-F. Yoshikawa; E. Zumstein; H. Yoshikawa; A. Danchin
errShare
errSave
On the Assessment of Numerical Wave Makers in CFD Simulations
err2019-02-13
err0
errOAAI
errChristian Windt; Josh Davidson; Pál Schmitt; John V. Ringwood
errShare
errSave
Audit Partners’ Risk Tolerance and the Impact on Audit Quality
err2019-01-01
err0
PREAI
errJeffrey A. Pittman; Sarah E. Stein; Delia F. Valentine
errShare
errSave
no more