arrow
返回

Context-Aware Emotion Recognition Based on Visual Relationship Detection

delete2021-01-01
delete18
delete
OA
AI
M
Manh-Hung Hoang
S
Soo-Hyung Kim
H
Hyung-Jeong Yang
G
Guee-Sang Lee *
DOI:10.1109/ACCESS.2021.3091169delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Emotion recognition, which is a part of affective computing, draws a lot of attention from researchers because of its broad applications. Unlike previous approaches with the aim to recognize humans' emotional state using facial expression, speech or gesture, some researchers see the potential of the contextual information from the scene. Hence, in addition to the employment of the main subject, the general background data is also considered as the complementary cues for emotion prediction. However, most of the existing works still have some limitations in deeply exploring the scene-level context. In this paper, to fully exploit the essences of context, we propose the emotional state prediction method based on visual relationship detection between the main target and the adjacent objects from the background. Specifically, we utilize both the spatial and semantic features of objects in the scene to calculate the influences of all context-related elements and their properties of impact (positive, negative, or neutral) on the main subject by a modified attention mechanism. After that, the model incorporates those features with scene context and body features of the target person to predict their emotional states. Our experimental results achieve state-of-the-art performance on the CAER-S dataset and competitive results on the EMOTIC benchmark.
Keyword:
Feature extraction
Visualization
Emotion recognition
Face recognition
Streaming media
Semantics
Proposals
Emotion recognition
context-aware
visual relationship detection
human-object interaction detection
deep learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

C
Chonnam National University
学者数:
1.7W
论文数: 1.6W
被引数: 1.4W
引用论文

引用论文

Compartment-dependent activities of Wnt3a/β-catenin signaling during vertebrate axial extension
err2014-10-01
err0
errOAAI
errArnon Dias Jurberg; Rita Aires; Ana Nóvoa; Jennifer Elizabeth Rowland; Moisés Mallo
err分享
err收藏
学者 查看更多内容