.png){kind=icon}
返回
Multi-granularity hypergraph-guided transformer learning framework for visual classification
.png){kind=icon}
PRE
AI
DOI：10.1007/s00371-024-03541-w.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Fine-grained single-label classification tasks aim to distinguish highly similar categories but often overlook inter-category relationships. Hierarchical multi-granularity visual classification strives to categorize image labels at various hierarchy levels, offering optimize label selection for people. This paper addresses the hierarchical multi-granularity classification problem from two perspectives: (1) effective utilization of labels at different levels and (2) efficient learning to distinguish multi-granularity visual features. To tackle these issues, we propose a novel multi-granularity hypergraph-guided transformer learning framework (MHTL), seamlessly integrating swin transformers and hypergraph neural networks for handling visual classification tasks. Firstly, we employ swin transformer as an image hierarchical feature learning (IHFL) module to capture hierarchical features. Secondly, a feature reassemble (FR) module is applied to rearrange features at different hierarchy levels, creating a spectrum of features from coarse to fine-grained. Thirdly, we propose a feature relationship mining (FRM) module, to unveil the correlation between features at different granularity. Within this module, we introduce a learnable hypergraph modeling method to construct coarse to fine-grained hypergraph structures. Simultaneously, multi-granularity hypergraph neural networks are employed to explore grouping relationships across different granularities, thereby enhancing the learning of semantic feature representations. Finally, we adopt a multi-granularity classifier (MC) to predict hierarchical label probabilities. Experimental results demonstrate that MHTL outperforms other state-of-the-art classification methods across three multi-granularity datasets. The source code and models are released at https://github.com/JJJTF/MHTL.
Keyword:
Hierarchical multi-granularity
Visual classification
Hypergraph neural network
Swin transformer
期刊
IF:
2.9
论文数:
4.6K
被引数:
6.5K
机构
引用论文
.png){kind=icon}
SR-GNN: Spatial Relation-Aware Graph Neural Network for Fine-Grained Image CategorizationSr-gnn: 用于细粒度图像分类的空间关系感知图神经网络
OAAI
OAAI分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Fine-grained recognition: Multi-granularity labels and category similarity matrix细粒度识别: 多粒度标签和类别相似度矩阵
PREAI
分享收藏
Pertussis toxin attenuates angiotensin II-induced vasoconstriction and inhibition of renin release
PREAI
分享收藏
查看更多内容