arrow
Return

ATAL: Active Learning Using Adversarial Training for Data Augmentation

delete2024-02-01
delete0
PRE
AI
X
Xuanwei Lin
X
Ximeng Liu *
B
B.Y. Chen
Y
Yuyang Wang
C
Chen Dong
P
Pengzhen Hu
DOI:10.1109/JIOT.2023.3300300delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Active learning (AL) tries to maximize the model's performance when the labeled data set is limited, and the annotation cost is high. Although it can be efficiently implemented in deep neural networks (DNNs), it is questionable whether the model can maintain the ability to generalize well when there are significant distributional deviations between the labeled and unlabeled data sets. In this article, we consider introducing adversarial training and adversarial samples into AL to mitigate the problem of degraded generalization performance due to different data distributions. In particular, our proposed adversarial training AL (ATAL) has two advantages, one is that adversarial training by different networks enables the network to have better prediction performance and robustness with limited labeled samples. The other is that the adversarial samples generated by the adversarial training can effectively expand the labeled data set so that the designed query function can efficiently select the most informative unlabeled samples based on the expanded labeled data set. Extensive experiments have been performed to verify the feasibility and efficiency of our proposed method, i.e., CIFAR-10 demonstrates the effectiveness of our method-new state-of-the-art robustness and accuracy are achieved.
Keywords:
Training
Data models
Generative adversarial networks
Labeling
Robustness
Uncertainty
Bayes methods
Active learning (AL)
adversarial learning
adversarial samples
data distribution
robustness

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

N
Northwestern Polytechnical University
Scholars:
4.6W
Papers: 3.7W
Citations: 5.3W
F
fuzhou university
Scholars:
3.2W
Papers: 2.1W
Citations: 31