arrow
返回

SLTRN: Sample-level transformer-based relation network for few-shot classification

delete2024-08-01
delete1
PRE
AI
Z
Zhe Sun *
Z
Zheng, Wang
M
Mingyang Wang
DOI:10.1016/j.neunet.2024.106344delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Few-shot classification recognizes novel categories with limited labeled samples. The classic Relation Network (RN) compares support-query sample pairs for few-shot classification but overlooks support set contextual information, limiting its comparison capabilities. This work reformulates learning the relationship between query samples and each support class as a seq2seq problem. We introduce a Sample-level Transformer-based Relation Network (SLTRN) that utilizes sample-level self-attention to enhance the comparison ability of the relationship module by mining potential relationships among support classes. SLTRN demonstrates comparable performance with state-of-the-art methods on benchmarks, particularly excelling in the 1-shot setting with 52.11% and 67.55% accuracy on miniImageNet and CUB, respectively. Extensive ablation experiments validate the effectiveness and optimal settings of SLTRN. The experimental code for this work is available at https://github.com/ ZitZhengWang/SLTRN.
Keyword:
Few-shot learning
SLTRN
SLTRM
Transformer

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

Y
Yanshan University
学者数:
1.7W
论文数: 1.1W
被引数: 1.3W
引用论文

引用论文

Transformer-Based Neural Network for Answer Selection in Question Answering
err2019-01-01
err68
errOAAI
errShao, Taihua; Guo, Yupu; Chen, Honghui; Hao, Zepeng
err分享
err收藏
Optimization of WAAM Deposition Patterns for T-crossing FeaturesT型交叉特征的WAAM沉积模式优化
err2016-01-01
err0
errOAAI
errGiuseppe Venturini; Filippo Montevecchi; Antonio Scippa; Gianni Campatelli
err分享
err收藏
err分享
err收藏
Unsupervised descriptor selection based meta-learning networks for few-shot classification
err2022-02-01
err26
PREAI
errHu, Zhengping; Li, Zijun; Wang, Xueyu; Zheng, Saiyue
err分享
err收藏
Learning to Learn Adaptive Classifier-Predictor for Few-Shot Learning
err2021-08-01
err76
PREAI
errLai, Nan; Kan, Meina; Han, Chunrui; Song, Xingguang; Shan, Shiguang
err分享
err收藏
Few-shot learning with deformable convolution for multiscale lesion detection in mammography
err2020-03-31
err11
PREAI
errLi, Ce; Zhang, Dong; Tian, Zhiqiang; Du, Shaoyi; Qu, Yanyun
err分享
err收藏
Shaping Visual Representations With Attributes for Few-Shot Recognition
err2022-01-01
err7
errOAAI
errChen, Haoxing; Li, Huaxiong; Li, Yaohui; Chen, Chunlin
err分享
err收藏
没有更多内容