Milmer: a framework for multiple instance learning based multimodal emotion recognition

doi:10.1016/j.neucom.2026.134368

Milmer: a framework for multiple instance learning based multimodal emotion recognition

2026-06-27

0

PRE

AI

DOI：10.1016/j.neucom.2026.134368

Original

Original request for help

Save

Abstract

En 中文

• We provide a comprehensive fusion of facial expressions and EEG for emotion recognition, with open-source code. • Transformer-based fusion effectively integrates visual and physiological modalities, outperforming simplistic methods. • Multi-instance learning and a fine-tuned Swin Transformer [1] extract facial features; cross-attention fuses with EEG.

Milmer: a framework for multiple instance learning based multimodal emotion recognition

Abstract

Journal

Organization