arrow
返回

Emotion recognition by skeleton-based spatial and temporal analysis

delete2024-03-01
delete2
PRE
AI
A
Abdulhalık Oğuz *
Ö
Ömer Faruk Ertuğrul
DOI:10.1016/j.eswa.2023.121981delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This study introduces an automatic emotion recognition system (AER) focusing on skeletal-based kinematic datasets for enhanced human-computer interaction. Departing from conventional approaches, it achieves realtime emotion recognition in real-life situations. The dataset covers seven emotions and undergoes assessment by eight diverse machine and deep learning algorithms. A thorough investigation is undertaken by varying window sizes and data states, including raw positions and feature-extracted data. The findings imply that incorporating advanced techniques like joint-related feature extraction and robust classifier models yields promising outcomes. Dataset augmentation via varying window sizes enriches insights into real-world scenarios. Evaluations exhibit classification accuracy surpassing 99% for small windows, 94% for medium, and exceeding 88% for larger windows, thereby confirming the robust nature of the approach. Furthermore, we highlight window size's impact on emotion detection and the benefits of combining coordinate axes for efficiency and accuracy. The analysis intricately examines the contributions of features at both the joint and axis levels, assisting in making well-informed selections. The study's contributions include carefully curated datasets, transparent code, and models, all of which ensure the possibility of replication. The paper establishes a benchmark that bridges theory and practicality, solidifying the proposed approach's effectiveness in balancing accuracy and efficiency. By pioneering advanced AER through kinematic data, it sets a new standard for efficacy while driving seamless human-computer interaction through rigorous analysis and strategic design.
Keyword:
Emotion recognition
Body posture
Deep learning
Machine learning
Feature selection
MoCap

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

Batman University 封面图
Batman University
学者数:
469
论文数: 635
被引数: 494
引用论文

引用论文

The involvement of DARPP-32 in the pathophysiology of schizophrenia
err2017-04-21
err0
errOAAI
errHaitao Wang; Mohd Farhan; Jiangping Xu; Philip Lazarovici; Wenhua Zheng
err分享
err收藏
A comparative analysis of gradient boosting algorithms梯度提升算法的比较分析
err2020-08-24
err863
errOAAI
errBentejac, Candice; Csorgo, Anna; Martinez-Munoz, Gonzalo
err分享
err收藏
Identification and heterologous expression of the globomycin biosynthetic gene cluster
err2023-06-01
err0
errOAAI
errDaniel Oves-Costales; Tetiana Gren; Eva Baggesgaard Sterndorff; Jesús Martín; Francisco Javier Ortiz-López; Tue S. Jørgensen; Xinglin Jiang; Fernando Román-Hurtado; Fernando Reyes; Olga Genilloud; Tilmann Weber
err分享
err收藏
Bagging predictorsBagging预测器
err1996-08-01
err1.0W
PREAI
errBreiman, L
err分享
err收藏
Review of Deep Learning Algorithms and Architectures
err2019-01-01
err1.1K
errOAAI
errShrestha, Ajay; Mahmood, Ausif
err分享
err收藏
A systematic review on affective computing: emotion models, databases, and recent advances情感计算的系统综述: 情感模型,数据库和最新进展
err2022-07-01
err172
errOAAI
errWang, Yan; Song, Wei; Tao, Wei; Liotta, Antonio; Yang, Dawei; Li, Xinlei; Gao, Shuyong; Sun, Yixuan; Ge, Weifeng; Zhang, Wei; Zhang, Wenqiang
err分享
err收藏
学者 查看更多内容