arrow
Return

Semantic-aware visual scene representation

delete2022-08-30
delete4
PRE
AI
M
Mohammad Javad Parseh
M
Mohammad Rahmanimanesh *
K
Keshavarzi, Parviz
Z
Zohreh Azimifar
DOI:10.1007/s13735-022-00246-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Scene classification is a mature and active computer vision task, due to the inherent ambiguity. The scene classification task aims to classify the visual scene images in predefined categories based on the ambient content, objects and the layout of the images. Inspired by human visual scene understanding, the visual scenes can be divided into two categories: (1) Object-based scenes that consist of the scene-specific objects and can be understood with those objects. (2) Layout-based scenes that are understandable based on the layout and the ambient content of the scene images. Scene-specific objects semantically help to understand object-based scenes, whereas the layout and the ambient content are effective in understanding layout-based scenes by representing the visual appearance of the scene images. Hence, one of the main challenges in scene classification is to create a discriminative representation that can provide a high-level perception of visual scenes. Accordingly, we have presented a discriminative hybrid representation of visual scenes, in which semantic features extracted from scene-specific objects are fused with visual features extracted from a deep CNN. The proposed scene representation method is used for the scene classification task and is applied to three benchmark scene datasets including: MIT67, SUN397, and UIUC Sports. Moreover, a new scene dataset, called Scene40, has been introduced, and also, the results of our proposed method have been presented on it. Experimental results show that our proposed method has achieved remarkable performance in the scene classification task and has outperformed the state-of-the-art methods.
Keywords:
Scene representation
Scene-specific object
Semantic feature
Deep visual feature

Journal

International Journal of Multimedia Information Retrieval cover
International Journal of Multimedia Information Retrieval
IF:
2.9
Papers:
280
Citations:
866

Organization

S
semnan university
Scholars:
3.4K
Papers: 3.2K
Citations: 2
S
Shiraz University
Scholars:
8.1K
Papers: 7.5K
Citations: 7.4K
Cited Papers

Cited Papers

Social science research on HIV in Vietnam: A critical review and future directions
err2013-07-26
err0
errOAAI
errAmy Dao; Jennifer S. Hirsch; Le Minh Giang; Richard G. Parker
errShare
errSave
Stearoyl-CoA Desaturase-1 (SCD1) Augments Saturated Fatty Acid-Induced Lipid Accumulation and Inhibits Apoptosis in Cardiac Myocytes
err2012-03-08
err0
errOAAI
errHiroki Matsui; Tomoyuki Yokoyama; Kenichi Sekiguchi; Daisuke Iijima; Hiroaki Sunaga; Moeno Maniwa; Manabu Ueno; Tatsuya Iso; Masashi Arai; Masahiko Kurabayashi
errShare
errSave
Learning visual features for relational CBIR
err2019-09-14
err10
PREAI
errMessina, Nicola; Amato, Giuseppe; Carrara, Fabio; Falchi, Fabrizio; Gennaro, Claudio
errShare
errSave
A Spatial Layout and Scale Invariant Feature Representation for Indoor Scene Classification
err2016-10-01
err59
errOAAI
errHayat, Munawar; Khan, Salman H.; Bennamoun, Mohammed; An, Senjian
errShare
errSave
Selective Search for Object Recognition
err2013-04-02
err3.9K
PREAI
errUijlings, J. R. R.; van de Sande, K. E. A.; Gevers, T.; Smeulders, A. W. M.
errShare
errSave
researcher View more