arrow
返回

TransFGVC: transformer-based fine-grained visual classification

delete2024-06-28
delete3
PRE
AI
L
Longfeng Shen *
B
Bin Hou
Y
Yulei Jian
X
Xisong Tu
张英杰 封面图
张英杰 (Yingjie Zhang)
L
Lingying Shuai *
F
Fangzhen Ge
陈得宝 封面图
陈得宝 (Debao Chen)
DOI:10.1007/s00371-024-03545-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Fine-grained visual classification (FGVC) aims to identify subcategories of objects within the same superclass. This task is challenging owing to high intra-class variance and low inter-class variance. The most recent methods focus on locating discriminative areas and then training the classification network to further capture the subtle differences among them. On the one hand, the detection network often obtains an entire part of the object, and positioning errors occur. On the other hand, these methods ignore the correlations between the extracted regions. We propose a novel highly scalable approach, called TransFGVC, that cleverly combines Swin Transformers with long short-term memory (LSTM) networks to address the above problems. The Swin Transformer is used to obtain remarkable visual tokens through self-attention layer stacking, and LSTM is used to model them globally, which not only accurately locates the discriminative region but also further introduces global information that is important for FGVC. The proposed method achieves competitive performance with accuracy rates of 92.7%, 91.4% and 91.5% using the public CUB-200-2011 and NABirds datasets and our Birds-267-2022 dataset, and the Params and FLOPs of our method are 25% and 27% lower, respectively, than the current SotA method HERBS. To effectively promote the development of FGVC, we developed the Birds-267-2022 dataset, which has 267 categories and 12,233 images.
Keyword:
Computer vision
Fine-grained visual classification
LSTM
Swin Transformer
Birds-267-2022 dataset

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

H
Huaibei Normal University
学者数:
2.4K
论文数: 1.6K
被引数: 2.1K
引用论文

引用论文

Hepatocyte Polyploidy: Driver or Gatekeeper of Chronic Liver Diseases
err2021-10-14
err0
errOAAI
errRomain Donne; Flora Sangouard; Séverine Celton-Morizur; Chantal Desdouets
err分享
err收藏
High prevalence of malaria in a non-endemic setting among febrile episodes in travellers and migrants coming from endemic areas: a retrospective analysis of a 2013–2018 cohort
err2021-11-27
err0
errOAAI
errAlejandro Garcia-Ruiz de Morales; Covadonga Morcate; Elena Isaba-Ares; Ramon Perez-Tanoira; Jose A. Perez-Molina
err分享
err收藏
Phantom Pain
err
IF0
err1997-01-01
err0
PREAI
errRichard A. Sherman
err分享
err收藏
Avoidance of false positives
err1990-03-01
err0
errOAAI
errP. A. KITCHIN; Z. SZOTYORI; C. FROMHOLC; N. ALMOND
err分享
err收藏
学者 查看更多内容