.png){kind=icon}
.png){kind=icon}
Return
The intricate dance of emotions and psychophysiology: unveiling the secrets of microexpressions
.png){kind=icon}
PRE
AI
S
S
S
S
A
H
DOI：10.7717/peerj-cs.3420.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Background: Emotion recognition plays a pivotal role in behavioral analysis, mental health assessment, and human-computer interaction. Micro-expressions, which are brief and involuntary facial movements, offer valuable insights into concealed emotions. However, validating micro-expressions remains a challenge due to their subtlety and short duration. This study aims to enhance the validation and classification of micro-expressions by integrating electromyogram (EMG) signals with facial action units (AUs). Methods: EMG data was collected using the EMG Muscle Sensor Module V3.0, interfaced with an Arduino Mega 2560 microcontroller. To ensure signal clarity, various data filtration techniques were applied to eliminate noise, motion artifacts, and baseline interferences. The cleaned EMG signals were used to extract features relevant to facial muscle activity. These features were then analyzed using convolutional neural networks (CNN) and long short-term memory (LSTM) models. The CNN model focused on spatial pattern recognition in muscle activation, while the LSTM model captured temporal dependencies in the signal sequence. Results: The CNN-based model achieved an accuracy of 97.62% in emotion classification, while the LSTM model demonstrated a comparable accuracy of 96.47%. These results indicate a high degree of reliability in detecting emotions based on EMG signals and their correspondence to facial action units. The study also highlighted several limitations of existing emotion recognition frameworks, including reduced accuracy, limited emotion representation, and insufficient dataset diversity. The proposed integration of EMG signals with facial action units provides a reliable and accurate framework for micro-expression validation. By addressing key limitations in current models, this research contributes to the development of more robust and interpretable emotion recognition systems. Future work will focus on the integration of multimodal signals and the use of more diverse datasets to enhance generalizability across populations and environments.
Keywords:
Micro-expressions
Action units
EMG signals
Machine learning
Mental health
Mental disorder
Journal
IF:
2.5
Papers:
3.3K
Citations:
6.9K
Organization
Cited Papers