arrow
返回

Joint Input and Output Space Learning for Multi-Label Image Classification

delete2021-01-01
delete36
PRE
AI
J
Jiahao Xu *
H
Hongda Tian
Z
Zhiyong Wang
王
王洋 (Yang Wang)
康
康文雄 (Wenxiong Kang)
CHEN Fang 封面图
CHEN Fang (Fang Chen)
DOI:10.1109/TMM.2020.3002185delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-label image classification aims to predict the labels associated with a given image. While most existing methods utilize unified image representations, extracting label-specific features through input space learning would improve the discriminative power of the learned features. On the other hand, most feature learning studies often ignore the learning in the output label space, although taking advantage of label correlations can boost the classification performance. In this paper, we propose a deep learning framework that incorporates flexible modules which can learn from both input and output spaces for multi-label image classification. For the input space learning, we devise a label-specific feature pooling method to refine convolutional features for obtaining features specific to each label. For the output space learning, we design a Two-Stream Graph Convolutional Network (TSGCN) to learn multi-label classifiers by mapping spatial object relationships and semantic label correlations. More specifically, we build object spatial graphs to characterize the spatial relationships among objects in an image, which supplements the label semantic graphs modelling the semantic label correlations. Experimental results on two popular benchmark datasets (i.e., Pascal VOC and MS-COCO) show that our proposed method achieves superior performance over the state-of-the-arts.
Keyword:
Feature extraction
Correlation
Task analysis
Semantics
Deep learning
Visualization
Benchmark testing
Multi-label image classification
label-specific feature
label correlations
graph convolutional network
deep learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Multi-instance multi-label learning多实例多标签学习
err2012-01-01
err371
errOAAI
errZhou, Zhi-Hua; Zhang, Min-Ling; Huang, Sheng-Jun; Li, Yu-Feng
err分享
err收藏
Image Retagging Using Collaborative Tag Propagation
err2011-08-01
err59
PREAI
errLiu, Dong; Yan, Shuicheng; Hua, Xian-Sheng; Zhang, Hong-Jiang
err分享
err收藏
Multi-Instance Multi-Label Learning Combining Hierarchical Context and its Application to Image Annotation
err2016-08-01
err32
PREAI
errDing, Xinmiao; Li, Bing; Xiong, Weihua; Guo, Wen; Hu, Weiming; Wang, Bo
err分享
err收藏
Learning multi-label scene classification学习多标签场景分类
err2004-09-01
err2.0K
PREAI
errBoutell, MR; Luo, JB; Shen, XP; Brown, CM
err分享
err收藏
学者 查看更多内容