arrow
Return

Scene Recognition With Prototype-Agnostic Scene Layout

delete2020-01-01
delete46
delete
OA
AI
G
Gongwei Chen
宋
宋新航 (Xinhang Song)
H
Haitao Zeng
S
Shuqiang Jiang *
DOI:10.1109/TIP.2020.2986599delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Exploiting the spatial structure in scene images is a key research direction for scene recognition. Due to the large intra-class structural diversity, building and modeling flexible structural layout to adapt various image characteristics is a challenge. Existing structural modeling methods in scene recognition either focus on predefined grids or rely on learned prototypes, which all have limited representative ability. In this paper, we propose Prototype-agnostic Scene Layout (PaSL) construction method to build the spatial structure for each image without conforming to any prototype. Our PaSL can flexibly capture the diverse spatial characteristic of scene images and have considerable generalization capability. Given a PaSL, we build Layout Graph Network (LGN) where regions in PaSL are defined as nodes and two kinds of independent relations between regions are encoded as edges. The LGN aims to incorporate two topological structures (formed in spatial and semantic similarity dimensions) into image representations through graph convolution. Extensive experiments show that our approach achieves state-of-the-art results on widely recognized MIT67 and SUN397 datasets without multi-model or multi-scale fusion. Moreover, we also conduct the experiments on one of the largest scale datasets, Places365. The results demonstrate the proposed method can be well generalized and obtains competitive performance.
Keywords:
Layout
Semantics
Prototypes
Image recognition
Convolution
Neural networks
Deformable models
Scene classification
convolution neural networks
graph neural networks
scene layout
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

I
institute of computing technology, cas
Scholars:
1.0K
Papers: 878
Citations: 1
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Ingestion of corrosive acids
err1989-09-01
err0
PREAI
errShowkat Ali Zargar; Rakesh Kochhar; Birender Nagi; Saroj Mehta; Satish Kumar Mehta
errShare
errSave
QuantumNAS: Noise-Adaptive Search for Robust Quantum Circuits
err2022-04-01
err0
errOAAI
errHanrui Wang; Yongshan Ding; Jiaqi Gu; Yujun Lin; David Z. Pan; Frederic T. Chong; Song Han
errShare
errSave
Vitamin D and Its Role in Ulcerative Colitis
err2015-11-01
err0
PREAI
errEhsan Shahverdi; Mohammad Amin Konjedi; Ashkan Shahverdi; Amin Dehghanian; Hossein Khedmat
errShare
errSave
Systematic review of surveillance systems and methods for early detection of exotic, new and re-emerging diseases in animal populations
err2014-09-12
err0
errOAAI
errV. RODRÍGUEZ-PRIETO; M. VICENTE-RUBIANO; A. SÁNCHEZ-MATAMOROS; C. RUBIO-GUERRI; M. MELERO; B. MARTÍNEZ-LÓPEZ; M. MARTÍNEZ-AVILÉS; L. HOINVILLE; T. VERGNE; A. COMIN; B. SCHAUER; F. DÓREA; D. U. PFEIFFER; J. M. SÁNCHEZ-VIZCAÍNO
errShare
errSave
Learning Contextual Dependence With Convolutional Hierarchical Recurrent Neural Networks
err2016-07-01
err87
errOAAI
errZuo, Zhen; Shuai, Bing; Wang, Gang; Liu, Xiao; Wang, Xingxing; Wang, Bing; Chen, Yushi
errShare
errSave
researcher View more