arrow
返回

Behavior capture guided engagement recognition

delete2025-04-09
delete0
PRE
AI
Y
Yijun Bei
G
Guo, Songyuan
K
Kewei Gao
DOI:10.1016/j.patcog.2025.111534delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
参与度识别旨在评估个体在各种活动中的投入程度,这在教育、医疗和驾驶等领域至关重要。然而,现有方法往往因过多数据和干扰而导致性能下降。本文介绍了一种新型模型——行为捕捉引导的Transformer(BCTR)。其关键创新之一在于提出的区域特征提取架构。具体而言,BCTR采用三个独立的类别标记来捕捉图像序列中的区域特征——眼部、头部和躯干。这些特征随后用于建模这些区域的动态流,以实现基于视频的参与度识别。BCTR的另一独特创新在于其能够模仿人类教师所使用的观察技术。通过利用帧级和视频级类别标记,该模型使用双分支检测静态和动态的脱节行为。这种方法不仅使BCTR实现了卓越的性能——在DAiSEE数据集上达到64.51%的准确率,在EmotiW-EP数据集上达到0.0602的均方误差损失——还通过识别这些脱节行为增强了参与度水平的可解释性。
Keyword:
Engagement recognition
Behavior capture
Video modeling

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

暂无机构信息
引用论文

引用论文

Video Transformer Network
err2021-10-01
err0
errOAAI
errDaniel Neimark; Omri Bar; Maya Zohar; Dotan Asselmann
err分享
err收藏
err分享
err收藏
Efficient Biomedical Signal Security Algorithm for Smart Internet of Medical Things (IoMTs) Applications
err2022-11-23
err0
errOAAI
errAchraf Daoui; Mohamed Yamni; Hicham Karmouni; Mhamed Sayyouri; Hassan Qjidaa; Saad Motahhir; Ouazzani Jamil; Walid El-Shafai; Abeer D. Algarni; Naglaa F. Soliman; Moustafa H. Aly
err分享
err收藏
Biomedical Multimedia Encryption by Fractional-Order Meixner Polynomials Map and Quaternion Fractional-Order Meixner Moments
err2022-01-01
err36
errOAAI
errDaoui, Achraf; Yamni, Mohamed; Karmouni, Hicham; Sayyouri, Mhamed; Qjidaa, Hassan; Ahmad, Musheer; Abd El-Latif, Ahmed A.
err分享
err收藏
Learning multi-label scene classification学习多标签场景分类
err2004-09-01
err2.0K
PREAI
errBoutell, MR; Luo, JB; Shen, XP; Brown, CM
err分享
err收藏
Automatic Detection of Students' Engagement During Online Learning: A Bagging Ensemble Deep Learning Approach
err2024-01-01
err0
errOAAI
errSantoni, Mayanda Mega; Basaruddin, T.; Junus, Kasiyah; Lawanto, Oenardi
err分享
err收藏
Three-dimensional DenseNet self-attention neural network for automatic detection of student's engagement
err2022-03-18
err48
errOAAI
errMehta, Naval Kishore; Prasad, Shyam Sunder; Saurav, Sumeet; Saini, Ravi; Singh, Sanjay
err分享
err收藏
err分享
err收藏
New color image encryption using hybrid optimization algorithm and Krawtchouk fractional transformations
err2022-12-11
err33
PREAI
errTahiri, Mohamed Amine; Karmouni, Hicham; Bencherqui, Ahmed; Daoui, Achraf; Sayyouri, Mhamed; Qjidaa, Hassan; Hosny, Khalid M.
err分享
err收藏
学者 查看更多内容