arrow
Return

SPOT: An Active Learning Algorithm for Efficient Deep Neural Network Training

delete2025-10-01
delete1
PRE
AI
L
Luyang Fang
孟
孟澄 (Cheng Meng)
Z
Zhao Lin
王韬 cover
王韬 (Tao Wang)
刘
刘天明 (Tianming Liu)
Z
Zhong, Wenxuan
马
马萍 (Ping Ma) *
DOI:10.26599/BDMA.2025.9020011delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent advancements in deep neural networks heavily rely on large-scale labeled datasets. However, acquiring annotations for large datasets can be challenging due to annotation constraints. Active learning offers a promising solution to this problem by selectively labeling a small, strategically chosen subset of the unlabeled dataset. However, current active learning methods struggle with data that are unevenly distributed, which leads to the selection of subsets that fail to represent the entire dataset. To overcome this challenge, we introduce a novel active learning algorithm that integrates SPace-filling (SP) designs with the Optimal Transport (OT) technique (SPOT). SPOT technique utilizes optimal transport to effectively manage data from complex manifolds by mapping them to a uniformly distributed hypercube. Additionally, the spacefilling design ensures a better asymptotic convergence rate, ensuring that the selected subset encompasses the entire dataset more effectively than other sampling methods, such as random sampling. Our extensive experiments across various image datasets and models demonstrate the superiority of SPOT over existing baselines.
Keywords:
Active Learning (AL)
Optimal Transport (OT)
SPace-filling (SP)
sampling
deep learning
Active Learning (AL)
Optimal Transport (OT)
SPace-filling (SP)
sampling
deep learning

Journal

Big Data Mining and Analytics cover
Big Data Mining and Analytics
IF:
6.2
Papers:
274
Citations:
1.0K

Organization

R
Renmin University of China
Scholars:
8.1K
Papers: 7.7K
Citations: 1.1W
U
university system of georgia
Scholars:
7.3W
Papers: 6.6W
Citations: 101
U
University of Georgia
Scholars:
1.5W
Papers: 1.2W
Citations: 2.9W
researcher View more organizations
Cited Papers

Cited Papers

Queries revisited
err2004-02-01
err0
PREAI
errDana Angluin
errShare
errSave
Mask-Guided Vision Transformer for Few-Shot Learning
err2024-01-01
err0
PREAI
errChen, Yuzhong; Xiao, Zhenxiang; Pan, Yi; Zhao, Lin; Dai, Haixing; Wu, Zihao; Li, Changhe; Zhang, Tuo; Li, Changying; Zhu, Dajiang; Liu, Tianming; Jiang, Xi
errShare
errSave
Stream-based active learning for sentiment analysis in the financial domain
err2014-11-01
err0
PREAI
errJasmina Smailović; Miha Grčar; Nada Lavrač; Martin Žnidaršič
errShare
errSave
errShare
errSave
Minimax and maximin distance designs
err1990-10-01
err0
PREAI
errM.E. Johnson; L.M. Moore; D. Ylvisaker
errShare
errSave
The Computational Limits of Deep Learning
err2024-09-13
err0
errOAAI
errNeil Thompson; Kristjan Greenewald; Keeheon Lee; Gabriel F. Manso
errShare
errSave
researcher View more