Object semantics sentiment correlation analysis enhanced image sentiment classification

Jing Zhang

doi:10.1016/j.knosys.2019.105245

Return

Object semantics sentiment correlation analysis enhanced image sentiment classification

2020-03-01

PRE

DOI：10.1016/j.knosys.2019.105245

Original

Original request for help

Save

Abstract

En 中文

With the development of artificial intelligence and deep learning, image sentiment analysis has become a hotspot in computer vision and attracts more attention. Most of the existing methods focus on identifying the emotions by studying complex models or robust features from the whole image, which neglects the influence of object semantics on image sentiment analysis. In this paper, we propose a novel object semantics sentiment correlation model (OSSCM), which is based on Bayesian network, to guide the image sentiment classification. OSSCM is constructed by exploring the relationships between image emotions and the object semantics combination in the images, which can fully consider the effect of object semantics for image emotions. Then, a convolutional neural networks (CNN) based visual sentiment analysis model is proposed to analyze image sentiment from visual aspect. Finally, three fusion strategies are proposed to realize OSSCM enhanced image sentiment classification. Experiments on public emotion datasets Fl and Flickr_LDL, demonstrate that our proposed image sentiment classification method can achieve good performance on image emotion analysis, and outperform state of the art methods. (C) 2019 Elsevier B.V. All rights reserved.

Keywords:

Image sentiment classification

Object semantics

Bayesian network

Object semantics sentiment correlation model

Convolutional Neural Network

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.