返回
Student behavior recognition based on multitask learning
DOI:10.1007/s11042-022-14100-7.png)
摘要
En 中文
The assessment of students' classroom behavior is an important part of classroom teaching evaluation. However, teachers cannot timely, objectively and accurately evaluate the listening status of each student in the class. We offer a multitask classroom behavior recognition method that combines human pose estimation and object detection. First, the target detector extracts the individual region from the keyframe as the network's input. Then, the multitask heatmap network (MTHN) module extracts the intermediate heatmap of multi-scale feature association. The attitude estimation and target detection tasks are constructed by mapping relations to obtain the keypoints and object position information. Finally, the keypoints behavior vector and the metric vector are used to model the behavior, and a classroom behavior detection algorithm based on the fully connected network is designed. Additionally, we created a classroom dataset with pose estimation, objects, and behavior labels. Meanwhile, transfer learning is used to solve the problem of insufficient sample size. After several experiments, we show that the detection accuracy of the proposed multitask learning-based student behavior recognition algorithm reaches more than 90%.
Keyword:
Student behavior recognition
Multitask learning
Pose estimation
Object detection
期刊
IF:
3
论文数:
2.0W
被引数:
3.2W
机构
引用论文
Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
Renal Tubular Secretion of Tanshinol: Molecular Mechanisms, Impact on Its Systemic Exposure, and Propensity for Dose-Related Nephrotoxicity and for Renal Herb-Drug Interactions丹参素的肾小管分泌: 分子机制,对其全身暴露的影响以及剂量相关的肾毒性和肾草药相互作用的倾向

