arrow
Return

Distributed few-shot learning with prototype distribution correction

delete2023-11-20
delete0
PRE
AI
Z
Zhiling Fu
D
Dongfang Tang
P
Pingchuan Ma
Z
Zhe Wang *
W
Wen Gao
DOI:10.1007/s10489-023-05103-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Few-shot learning aims to learn a classifier that can perform well even if a few labeled samples are used for training. Many methods based on prototype models have recently been proposed and show good performance in few-shot learning. However, in the few-shot scenario, data is scarce. There is a deviation between the prototype calculated employing only a small amount of data in the support set and the actual prototype. Moreover, the features of the novel class extracted from the pre-trained model trained using base class data exhibit a bias. Additionally, the pre-trained model demonstrates high complexity and poor training efficiency. Therefore, we propose the Distributed Few-shot Learning with Prototype Distribution Correction to this end. Specifically, we employ pseudo-labels to fuse the sample features of the query set and modify the prototype to reduce the bias between the support and the query set. Then we utilize the features of the Gaussian distribution to transfer the base class features to the novel class to reduce the bias between novel classes and base classes. Finally, we combine distributed learning to improve the efficiency of the pre-trained model. We evaluate our method on Mini-ImageNet, Tiered-ImageNet, and CUB, three few-shot learning public datasets. The classification accuracy of our method improves in every case on every dataset and achieves state-of-the-art performance. In particular, the accuracy improves by 10.12% on 1-shot Mini-ImageNet.
Keywords:
Few-shot learning
Prototype correction
Distribution correction
Distributed learning

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

F
fudan university
Scholars:
11.8W
Papers: 7.7W
Citations: 121
Cited Papers

Cited Papers

DC discharge plasma studies for nanostructured carbon CVD
err2003-03-01
err0
PREAI
errA.N. Obraztsov; A.A. Zolotukhin; A.O. Ustinov; A.P. Volkov; Yu. Svirko; K. Jefimovs
errShare
errSave
Multimodality in meta-learning: A comprehensive survey
err2022-08-01
err35
errOAAI
errMa, Yao; Zhao, Shilin; Wang, Weixiao; Li, Yaoman; King, Irwin
errShare
errSave
In situ endothelialisation potential of a biofunctionalised nanocomposite biomaterial-based small diameter bypass graft
err2009-01-01
err0
PREAI
errAchala de Mel; Geoffrey Punshon; Bala Ramesh; Sandip Sarkar; Arnold Darbyshire; George Hamilton; Alexander M. Seifalian
errShare
errSave
Symmetry discovery with deep learning
err2022-05-26
err0
errOAAI
errKrish Desai; Benjamin Nachman; Jesse Thaler
errShare
errSave
A self-interpretable module for deep image classification on small data
err2022-08-05
err5
errOAAI
errLa Rosa, Biagio; Capobianco, Roberto; Nardi, Daniele
errShare
errSave
ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
Synthesis of (+)‐Schisanwilsonene A by Tandem Gold‐Catalyzed Cyclization/1,5‐Migration/Cyclopropanation
err2013-05-10
err0
errOAAI
errMorgane Gaydou; Ricarda E. Miller; Nicolas Delpont; Julien Ceccon; Antonio M. Echavarren
errShare
errSave
researcher View more