arrow
返回

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

delete2023-01-01
delete19
delete
OA
AI
J
Jialu Zhang
J
Jianfeng Ren *
Q
Qian Zhang
J
Jiang Liu
蒋旭东 封面图
蒋旭东 (Xudong Jiang)
DOI:10.1109/TIP.2023.3266161delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-label image classification is a fundamental but challenging task in computer vision. To tackle the problem, the label-related semantic information is often exploited, but the background context and spatial semantic information of related objects are not fully utilized. To address these issues, a multi-branch deep neural network is proposed in this paper. The first branch is designed to extract the discriminant information from regions of interest to detect target objects. In the second branch, a spatial context-aware approach is proposed to better capture the contextual information of an object in its surroundings by using an adaptive patch expansion mechanism. It helps the detection of small objects that are easily lost without the support of context information. The third one, the object-attentional branch, exploits the spatial semantic relations between the target object and its related objects, to better detect partially occluded, small or dim objects with the support of those easily detectable objects. To better encode such relations, an attention mechanism jointly considering the spatial and semantic relations between objects is developed. Two widely used benchmark datasets for multi-labeling classification, MS COCO and PASCAL VOC, are used to evaluate the proposed framework. The experimental results demonstrate that the proposed method outperforms the state-of-the-art methods for multi-label image classification.
Keyword:
Semantics
Image classification
Task analysis
Feature extraction
Context modeling
Object detection
Correlation
Multi-label image classification
adaptive patch expansion
spatial context-aware object detection
object clustering
spatial semantic attention

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
University of Nottingham Ningbo China
学者数:
2.9K
论文数: 3.1K
被引数: 0
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

Identification of an adult-specific glial progenitor cell
err1989-08-01
err0
PREAI
errGuus Wolswijk; Damian Wren; Peter Munro; Mark Noble
err分享
err收藏
err分享
err收藏
DELTA: A deep dual-stream network for multi-label image classification
err2019-07-01
err40
PREAI
errYu, Wan-Jin; Chen, Zhen-Duo; Luo, Xin; Liu, Wu; Xu, Xin-Shun
err分享
err收藏
学者 查看更多内容