arrow
返回

Visual sentiment analysis using data-augmented deep transfer learning techniques

delete2024-03-29
delete0
PRE
AI
H
Haoran Hong
W
Waneeza Zaheer
A
Aamir Wali *
DOI:10.1007/s00530-024-01308-wdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The use of visual content to express emotions on social media platforms has become increasingly popular. Visual sentiment analysis can be used to understand the sentiment conveyed by the users using images. Compared to text, visual sentiment analysis is a challenging task since images are a more condensed form of data, have ambiguity and do not have explicit textual clues. Recently, a few studies used deep transfer learning techniques for visual sentiment analysis but the results reported can be significantly improved. In this research paper, we introduce a novel architecture that combines data augmentation and transfer learning. Our approach involves feature fusion of the pretrained VGG16 and MobileNetV1 models, followed by fine-tuning using an SVM classifier using augmented training data. For evaluation, we used two image datasets. To augment these datasets, we apply various techniques. The proposed model is also compared with three other transfer techniques, as well as four machine learning models (excluding SVM). VGG16+MobileNetV1-SVM has the best accuracy of 96% and recall of 99% for both datasets. Compared to other studies that also employed the same dataset, the proposed model produced the best results.
Keyword:
Visual sentiment analysis
Feature fusion
VGG16
Data augmentation
Deep and transfer learning

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

暂无机构信息
引用论文

引用论文

Properties of reticulum cell sarcomas in SJL/J mice
err1977-07-01
err0
PREAI
errN.M. Ponzio; S.P. Lerman; J.M. Chapman; G.J. Thorbecke
err分享
err收藏
3D Integrated 300°C Tunable RF Oscillator exploiting AlGaN/GaN HEMT for High Temperature Applications基于AlGaN/GaN HEMT的高温应用3D集成300°C可调射频振荡器
err2021-06-07
err0
PREAI
errP. Palacios; T. Zweipfennig; A. Ottaviani; M. Saeed; C. Beckmann; M. Alomari; G. Lukens; H. Kalisch; J.N. Burghartz; A. Vescan; R. Negra
err分享
err收藏
err分享
err收藏
err分享
err收藏
Navigating by Landmarks
errCell
IF0
err2001-05-01
err0
errOAAI
errRobert L. Morris
err分享
err收藏
学者 查看更多内容