.png){kind=icon}
返回
Robust Few-Shot Learning Without Using Any Adversarial Samples
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2023.3336996.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The high cost of acquiring and annotating samples has made the few-shot learning problem of prime importance. Existing works mainly focus on improving performance on clean data and overlook robustness concerns on the data perturbed with adversarial noise. Recently, a few efforts have been made to combine the few-shot problem with the robustness objective using sophisticated meta-learning techniques. These methods rely on the generation of adversarial samples in every episode of training, which further adds to the computational burden. To avoid such time-consuming and complicated procedures, we propose a simple but effective alternative that does not require any adversarial samples. Inspired by the cognitive decision-making process in humans, we enforce high-level feature matching between the base class data and their corresponding low-frequency samples in the pretraining stage via self distillation. The model is then fine-tuned on the samples of novel classes where we additionally improve the discriminability of low-frequency query set features via cosine similarity. On a one-shot setting of the CIFAR-FS dataset, our method yields a massive improvement of 60.55% and 62.05% in adversarial accuracy on the projected gradient descent (PGD) and state-of-the-art auto attack, respectively, with a minor drop in clean accuracy compared to the baseline. Moreover, our method only takes 1.69x of the standard training time while being approximate to 5x faster than the state-of-the-art adversarial meta-learning methods. The code is available at https://github.com/vcl-iisc/robust-few-shot-learning.
Keyword:
Robustness
Training
Metalearning
Computational modeling
Optimization
Task analysis
Standards
Adversarial defense
adversarial robustness
few-shot learning
Fourier transform
self distillation
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
.png){kind=icon}
Service-Related Exposures and Physical Health Trajectories Among Aging Veteran Men老年退伍军人中与服务相关的暴露和身体健康轨迹OAAI
OAAI分享收藏
查看更多内容