arrow
返回

Explore pretraining for few-shot learning

delete2023-05-27
delete0
PRE
AI
Y
Yan Li
黄
黄金杰 (Jinjie Huang) *
DOI:10.1007/s11042-023-15223-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Few-shot learning aims to learn to classify new categories with a few samples. Pretraining the model on the base class can improve the performance of the model on the new category. To further improve the pretraining performance of the model on the base class, we propose a two-stage model pretraining method. In the first stage, we conduct Simsiam contrastive learning pretraining, which can help the model learn invariant knowledge. In the second stage, we conduct multi-task pretraining for general classification tasks and rotation prediction tasks, which can help the model learn the equivalent knowledge. Two pretraining stages can significantly enhance the model's capacity to learn new categories and enhance the effectiveness of few-shot categorization. Experiments show that our method achieves State-of-the-art few-shot classification performance on the mini-ImageNet and FC100 datasets for 1-shot and 5-shot tasks.
Keyword:
Computer vision
Deep learning
Image classification
Few-shot learning

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

暂无机构信息
引用论文

引用论文

Interplanetary dust from the explosive dispersal of hydrated asteroids by impacts
err2003-05-01
err0
PREAI
errKazushige Tomeoka; Koji Kiriyama; Keiko Nakamura; Yasuhiro Yamahana; Toshimori Sekine
err分享
err收藏
DC discharge plasma studies for nanostructured carbon CVD
err2003-03-01
err0
PREAI
errA.N. Obraztsov; A.A. Zolotukhin; A.O. Ustinov; A.P. Volkov; Yu. Svirko; K. Jefimovs
err分享
err收藏
err分享
err收藏
err分享
err收藏
Human Inertial Thinking Strategy: A Novel Fuzzy Reasoning Mechanism for IoT-Assisted Visual Monitoring
err2023-03-01
err24
PREAI
errLiu, Shuai; Wang, Shuai; Liu, Xinyu; Dai, Jianhua; Muhammad, Khan; Gandomi, Amir H. H.; Ding, Weiping; Hijji, Mohammad; de Albuquerque, Victor Hugo C.
err分享
err收藏
Dynamic simulation of a planet roller bearing considering the cage bridge crack
err2022-01-01
err0
PREAI
errZhifeng Shi; Jing Liu; Hongwu Li; Qiang Zhang; Guijian Xiao
err分享
err收藏
学者 查看更多内容