arrow
返回

Semantic embedding: scene image classification using scene-specific objects

delete2022-10-18
delete3
PRE
AI
M
Mohammad Javad Parseh
M
Mohammad Rahmanimanesh *
K
Keshavarzi, Parviz
Z
Zohreh Azimifar
DOI:10.1007/s00530-022-01010-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Visual scene understanding is a hot and challenging topic in image processing that aims to understand the general (global) concept of a scene image. In this paper, we propose a novel image embedding algorithm using a learned embedded space, which introduces a high-level semantic representation of the scene images. The learned embedded space as a suitable semantic framework for visual concepts can be used in most applications such as image captioning, Visual Question Answering (VQA), and scene recognition or classification. Inspired by the human inference mechanism in visual scene understanding, the proposed method learns a semantic embedded space of visual concepts using prior semantic knowledge. Prior knowledge is extracted from ConceptNet as one of the most comprehensive knowledge graphs in the form of semantic vectors and is transformed to the learned embedded space with a transformation function. The transformation function is learned by solving a minimization problem. To evaluate our proposed approach, we introduce a scene image dataset called Scene23, which is based on the VisualGenome dataset. A non-linear SVM classifier is utilized to classify the representations of images to the scene categories. The experimental results show 99.44% classification accuracy on the Scene23 dataset. Also, we evaluated our proposed method by the UIUC Sports and MIT67 datasets. Experimental results indicate that our proposed method outperforms other state-of-the-art methods on the UIUC Sports dataset and achieves competitive results on the MIT67 dataset.
Keyword:
Scene classification
Semantic embedding
Scene-specific objects

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

S
semnan university
学者数:
3.4K
论文数: 3.2K
被引数: 2
S
Shiraz University
学者数:
8.1K
论文数: 7.5K
被引数: 7.4K
引用论文

引用论文

A novel endoesophageal magnetic device to prevent gastroesophageal reflux
err2008-12-31
err0
PREAI
errMauro Bortolotti; Annamaria Grandis; Giosuè Mazzero
err分享
err收藏
Discriminative compact pyramids for object and scene recognition
err2012-04-01
err51
PREAI
errElfiky, Noha M.; Shahbaz Khan, Fahad; van de Weijer, Joost; Gonzalez, Jordi
err分享
err收藏
MICAL2is a novel human cancer gene controlling mesenchymal to epithelial transition involved in cancer growth and invasion
err2015-12-12
err0
errOAAI
errSara Mariotti; Ivana Barravecchia; Carla Vindigni; Angela Pucci; Michele Balsamo; Rosaliana Libro; Vera Senchenko; Alexey Dmitriev; Emanuela Jacchetti; Marco Cecchini; Franco Roviello; Michele Lai; Vania Broccoli; Massimiliano Andreazzoli; Chiara M. Mazzanti; Debora Angeloni
err分享
err收藏
A Spatial Layout and Scale Invariant Feature Representation for Indoor Scene Classification
err2016-10-01
err59
errOAAI
errHayat, Munawar; Khan, Salman H.; Bennamoun, Mohammed; An, Senjian
err分享
err收藏
Image classification by combining local and global features
err2018-04-07
err57
PREAI
errKabbai, Leila; Abdellaoui, Mehrez; Douik, Ali
err分享
err收藏
学者 查看更多内容