arrow
Return

Milmer: a framework for multiple instance learning based multimodal emotion recognition

delete2026-06-27
delete0
PRE
AI
Z
Zaitian Wang
J
Jian He
梁堉 cover
梁堉 (Yu Liang) *
胡晰远 cover
胡晰远 (Xiyuan Hu)
T
Tianhao Peng
王恺忻 cover
王恺忻 (Kaixin Wang)
J
Jiakai Wang
C
Chenlong Zhang
W
Weili Zhang
牛
牛爽 (Shuang Niu)
谢笑阳 cover
谢笑阳 (Xiaoyang Xie)
DOI:10.1016/j.neucom.2026.134368delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• We provide a comprehensive fusion of facial expressions and EEG for emotion recognition, with open-source code. • Transformer-based fusion effectively integrates visual and physiological modalities, outperforming simplistic methods. • Multi-instance learning and a fine-tuned Swin Transformer [1] extract facial features; cross-attention fuses with EEG.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

Z
Zhongguancun Laboratory
Scholars:
274
Papers: 200
Citations: 0
B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
B
beijing university of technology
Scholars:
6.0K
Papers: 2.0K
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Transformers for EEG-Based Emotion Recognition: A Hierarchical Spatial Information Learning Model
err2022-03-01
err108
PREAI
errWang, Zhe; Wang, Yongxiong; Hu, Chuanfei; Yin, Zhong; Song, Yu
errShare
errSave
A Review of Emotion Recognition Using Physiological Signals
errSENSORS
IF3.5
err2018-06-28
err518
errOAAI
errShu, Lin; Xie, Jinyan; Yang, Mingyue; Li, Ziyi; Li, Zhenqi; Liao, Dan; Xu, Xiangmin; Yang, Xinyi
errShare
errSave
errShare
errSave
Cross-Subject Multimodal Emotion Recognition Based on Hybrid Fusion
err2020-01-01
err96
errOAAI
errCimtay, Yucel; Ekmekcioglu, Erhan; Caglar-Ozhan, Seyma
errShare
errSave
A review of multimodal emotion recognition from datasets, preprocessing, and fusion methods
err2023-12-01
err27
PREAI
errPan, Bei; Hirota, Kaoru; Jia, Zhiyang; Dai, Yaping
errShare
errSave
Cross-Subject Emotion Recognition Using Flexible Analytic Wavelet Transform From EEG Signals
err2019-03-15
err203
PREAI
errGupta, Vipin; Chopda, Mayur Dahyabhai; Pachori, Ram Bilas
errShare
errSave
Facial expression recognition with grid-wise attention and visual transformer
err2021-11-01
err0
PREAI
errQionghao Huang; Changqin Huang; Xizhe Wang; Fan Jiang
errShare
errSave
errShare
errSave
researcher View more