返回
Video Affective Content Analysis by Exploring Domain Knowledge
DOI:10.1109/TAFFC.2019.2912377.png)
摘要
En 中文
Film grammar is often used to invoke certain emotional experiences from audiences through changing visual, speech, and musical elements of videos. Such film grammar, referred to as domain knowledge, is of great importance for video affective content analysis but has not been thoroughly examined in research. In this paper, we propose an improved method for emotion recognition and regression from videos through exploring domain knowledge. We first investigate the domain knowledge of visual, speech, and musical elements, and infer probabilistic dependencies between elements and emotions from the summarized film grammar. Then, we transfer the summarized dependencies between elements and emotions as constraints, and formulate video affective content analysis, including both emotion recognition and emotion regression from video content, as a constrained optimization problem. Experiments on the LIRIS-ACCEDE database, the FilmStim database, and the DEAP database demonstrate that the proposed video affective content analysis method can successfully leverage well-established film grammar to improve emotion recognition and regression from video content.
Keyword:
Lighting
Image color analysis
Visualization
Emotion recognition
Feature extraction
Grammar
Music
Video affective content analysis
domain knowledge
visual
speech
music elements
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.8
论文数:
1.3K
被引数:
9.1K
机构
引用论文
Introducing the Geneva Multimodal Expression Corpus for Experimental Research on Emotion Perception
EMOTION
IF3.6

