.png){kind=icon}
返回
Audio-Visual Automatic Group Affect Analysis
.png){kind=icon}
PRE
AI
DOI：10.1109/TAFFC.2021.3104170.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Affective computing has progressed well due to methods, which can identify a person's posed and spontaneous perceived affect with high accuracy. This paper focuses on group-level affect analysis on videos, which is one of the first few multimodal group-level affect analysis studies. There are many challenges on video-based group-level affect analysis as most of the work is focused on either a single person's affect recognition or image-based group affect analysis. To address this, first, we present an audio-visual perceived group affect dataset - 'Video-level Group AFfect (VGAF)'. VGAF is a large-scale dataset consisting of 4,183 group videos. The videos are collected from YouTube with large variations in the keywords for collecting data across different genders, group settings, group sizes, illuminations and poses. The variety within the dataset will help the study of perception of group affect in a real environment. The data is manually annotated for three group affect classes - positive, neutral, and negative. Further, a fusion based audio-visual method is proposed to set a benchmark performance on the proposed dataset. The experimental results show the effectiveness of facial, holistic and speech features for group-level affect analysis. The baseline code, dataset, and pre-trained models are available at [LINK].
Keyword:
Videos
Face recognition
Emotion recognition
Affective computing
Speech recognition
Feature extraction
Cameras
Group-level affect recognition
affect recognition
affective computing
期刊
IF:
9.8
论文数:
1.4K
被引数:
9.1K
机构
引用论文
.png){kind=icon}
分享收藏Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements重新考虑情感表达: 从人类面部运动推断情感的挑战
OAAI
OAAI分享收藏分享收藏
查看更多内容