arrow
返回

Student behavior recognition based on multitask learning

delete2022-11-25
delete14
PRE
AI
J
Jianwen Mo
朱瑞 封面图
朱瑞 (Rui Zhu)
袁
袁华 (Hua Yuan) *
Z
Zhaoyu Shou
L
Linping Chen
DOI:10.1007/s11042-022-14100-7delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
The assessment of students' classroom behavior is an important part of classroom teaching evaluation. However, teachers cannot timely, objectively and accurately evaluate the listening status of each student in the class. We offer a multitask classroom behavior recognition method that combines human pose estimation and object detection. First, the target detector extracts the individual region from the keyframe as the network's input. Then, the multitask heatmap network (MTHN) module extracts the intermediate heatmap of multi-scale feature association. The attitude estimation and target detection tasks are constructed by mapping relations to obtain the keypoints and object position information. Finally, the keypoints behavior vector and the metric vector are used to model the behavior, and a classroom behavior detection algorithm based on the fully connected network is designed. Additionally, we created a classroom dataset with pose estimation, objects, and behavior labels. Meanwhile, transfer learning is used to solve the problem of insufficient sample size. After several experiments, we show that the detection accuracy of the proposed multitask learning-based student behavior recognition algorithm reaches more than 90%.
Keyword:
Student behavior recognition
Multitask learning
Pose estimation
Object detection

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

G
Guilin Institute of Information Technology
学者数:
49
论文数: 36
被引数: 0
G
Guilin University of Electronic Technology
学者数:
7.4K
论文数: 5.2K
被引数: 5.4K
引用论文

引用论文

Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
err2011-02-01
err0
PREAI
errYasuhiko Ishikawa; Kazuaki Yamauchi; Chihiro Yamamoto; Michiharu Tabe
err分享
err收藏
err分享
err收藏
Nanodiamond films growth on porous silicon substrates for electrochemical applications
err2005-03-01
err0
PREAI
errN.G. Ferreira; A.F. Azevedo; A.F. Beloto; M. Amaral; F.A. Almeida; F.J. Oliveira; R.F. Silva
err分享
err收藏
A new general method for protection of the hydroxyl function
err1976-03-01
err0
PREAI
errE.J. Corey; Jean-Louis Gras; Peter Ulrich
err分享
err收藏
学者 查看更多内容