.png){kind=icon}
Return
Multi-label image classification with multi-layered multi-perspective dynamic semantic representation
.png){kind=icon}
PRE
AI
DOI：10.1007/s10994-023-06440-8.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
With the development of deep learning techniques, multi-label image classification tasks have achieved good performance. Recently, graph convolutional network has been proved to be an effective way to explore the labels dependencies. However, due to the complexity of label semantic relations, the static dependencies obtained by existing methods cannot consider the overall characteristics of an image and accurately locate the target region. Therefore, we propose the Multi-layered Multi-perspective Dynamic Semantic Representation (MMDSR) for multi-label image classification, which mainly includes three important modules: (1) multi-scale feature reconstruction, which aggregates complementary information at different levels in convolutional neural network through cross-layer attention, it can effectively identify target categories of different sizes; (2) channel dual-branch cross-attention module, we propose to explore the correlation between global information and local features in multi-scale features by the way of adaptive cross-fusion to locate the target area more accurately; (3) dynamic semantic representation module, we design the multi-perspective weighted cosine measure to construct content-based label dependencies for each image to dynamically construct a semantic relationship graph. Extensive experiments on the two datasets MS-COCO and VOC2007 have verified that the classification performance of our proposed MMDSR is better than many state-of-the-art methods.
Keywords:
Multi-label image classification
Multi-scale feature
Attention mechanism
Semantic relationship graph
Journal
IF:
2.9
Papers:
2.7K
Citations:
3.4W
Organization
Cited Papers
ShareSaveShareSave
A Semi-supervised Learning Approach Based on Adaptive Weighted Fusion for Automatic Image Annotation
PREAI
ShareSaveDetection of Coronary Artery Disease in Patients with Severe Aortic Stenosis with Noninvasive Methods.png)
Angiology
AngiologyIF0
PREAI
ShareSaveShareSaveShareSaveShareSave
View more