arrow
Return

Audio-Based Granularity-Adapted Emotion Classification

delete2018-04-01
delete4
PRE
AI
S
Sven Ewan Shepstone *
Z
Zheng‐Hua Tan
S
Søren Holdt Jensen
DOI:10.1109/TAFFC.2016.2598741delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper introduces a novel framework for combining the strengths of machine-based and human-based emotion classification. Peoples' ability to tell similar emotions apart is known as emotional granularity, which can be high or low, and is measurable. This paper proposes granularity-adapted classification that can be used as a front-end to drive a recommender, based on emotions from speech. In this context, incorrectly predicted peoples' emotions could lead to poor recommendations, reducing user satisfaction. Instead of identifying a single emotion class, an adapted class is proposed, and is an aggregate of underlying emotion classes chosen based on granularity. In the recommendation context, the adapted class maps to a larger region in valence-arousal space, from which a list of potentially more similar content items is drawn, and recommended to the user. To determine the effectiveness of adapted classes, we measured the emotional granularity of subjects, and for each subject, used their pairwise similarity judgments of emotion to compare the effectiveness of adapted classes versus single emotion classes taken from a baseline system. A customized Euclidean-based similarity metric is used to measure the relative proximity of emotion classes. Results show that granularity-adapted classification can improve the potential similarity by up to 9.6 percent.
Keywords:
Emotion
affect
emotional granularity
multidimensional scaling
automatic classification
SVM
i-vector
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Affective Computing cover
IEEE Transactions on Affective Computing
IF:
9.8
Papers:
1.3K
Citations:
9.1K

Organization

A
aalborg university
Scholars:
1.6W
Papers: 1.7W
Citations: 22