.png){kind=icon}
.png){kind=icon}
Return
Multi-modal collaborative learning for facial expression recognition in e-learning platforms
.png){kind=icon}
OA
AI
DOI：10.1038/s41598-026-47189-z.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
In recent years, the task of recognizing facial expressions (FER) has become an important research topic in the development of intelligent educational systems. However, facial expressions are highly dynamic and exhibit substantial variability, which makes accurate recognition difficult. To address this challenge, we introduce a novel multi-modal Collaborative Learning (MaCLe) approach based on the CLIP model for FER applications in online learning scenarios. The implementation of collaborative prompt learning enhances generalization and dynamics. The effectiveness of the proposed model is validated on three widely used benchmarks, including RAF-DB, FER2013 and AffectNet. MaCLe achieves recognition accuracies of 95.45, 80.37 and 77.66% on these datasets, respectively. Ablation studies have demonstrated that an optimal depth of J = 7 and prompt length of 2–4 tokens enable this model to effectively balance accuracy and generalization. Furthermore, even with the integration of multi-modal prompt generation, MaCLe increases FLOPs by only approximately 0.1% in comparison to CoOp and Co-CoOp. Meanwhile, it demonstrates faster convergence, achieving results in 5 epochs compared to 10, and exhibits a lower parameter overhead with only a 2.85% increase compared to CLIP. The results indicate that MaCLe significantly enhances recognition accuracy and improves training efficiency and scalability within e-learning platforms.
Keywords:
Computational biology and bioinformatics
Mathematics and computing
Facial expression recognition (FER)
Multi-modal collaborative learning (MaCLe)
CLIP model
Collaborative prompt learning
Ablation studies
Science
Humanities and Social Sciences
multidisciplinary
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
3.9
Papers:
27.4W
Citations:
83.5W
Organization
View more organizations