.png){kind=icon}
返回
Multi-modal feature alignment networks for multi-label image classification
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2026.108629.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multi-label image classification is a classification task that assigns labels to multiple objects in an input image. Recent research ideas mainly focus on solving the semantic consistency of visual features and label features. However, since images contain complex scene content, the features captured by visual feature extraction networks based on grid or sequence representation may introduce redundant information or lack continuity when identifying irregular objects. In order to fully mine the visual information of complex objects in images and enhance the inter-modal interaction of images and labels, we introduce a flexible graph structure to explore the internal information of objects and design a multi-modal feature alignment (MMFA) network for multi-label image classification. To enhance the context awareness and semantic association of different patch regions, we propose a semantic-augmented interaction module that combines two kinds of visual semantic information with label embeddings for interactive learning. Finally, we refine the dependence between local intrinsic information and overall semantics by redefining semantic queries through semantically enhanced visual spatial features and graph aggregation features. Experiments on three large-scale public datasets: Microsoft COCO, Pascal VOC 2007 and NUS-WIDE demonstrate the effectiveness of our proposed MMFA and achieve state-of-the-art performance.
期刊
IF:
6.3
论文数:
8.2K
被引数:
3.0W
机构
引用论文
分享收藏分享收藏ProbMCL: Simple Probabilistic Contrastive Learning for Multi-Label Visual Classification.png)
ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)IF0
PREAI
分享收藏Mining Semantic Information With Dual Relation Graph Network for Multi-Label Image Classification利用双关系图网络挖掘语义信息进行多标签图像分类
PREAI
分享收藏GKGNet: Group K-Nearest Neighbor Based Graph Convolutional Network for Multi-label Image Recognition
PREAI
分享收藏
查看更多内容