arrow
返回

3D skeleton aware driver behavior recognition framework for autonomous driving system

delete2025-01-01
delete3
PRE
AI
R
Rongtian Huo
J
Junkang Chen
Y
Ye Zhang
高
高庆 (Qing Gao) *
DOI:10.1016/j.neucom.2024.128743delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The recognition of the driver's behaviors inside an autonomous vehicle can effectively address emergency handling in autonomous driving and is crucial for ensuring the driver's safety. Driver behavior recognition is a challenging task due to factors such as variations, diversities, complexities, and strong interferences in behaviors. In this paper, to realize the application in the autonomous driving scenes, a novel 3D skeleton aware behavior recognition framework is proposed to recognize various driver behaviors in autonomous driving systems. First, a 3D human pose estimation network (Pose-GTFNet) with temporal Transformer and spatial graph convolutional network (GCN) is designed to infer 3D human poses from 2D pose sequences. Second, based on the obtained 3D human pose sequences, a behavior recognition network (Beh-MSFNet) with multi-skeleton feature fusion is designed to recognize driver behaviors. In the experiments, the Pose-GTFNet and Beh-MSFNet can get the best performance compared with most state-of-the-art (SOTA) methods on the Human3.6M human pose dataset, JHMDB and SHREC action recognition dataset, respectively. In addition, the proposed driver behavior recognition framework can achieve SOTA performance on the Drive&Act and Driver-Skeleton driver behavior datasets.
Keyword:
3D skeleton
Driver behavior recognition
Autonomous driving system

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
引用论文

引用论文

MicroRNA-23a expression in paraffin-embedded specimen correlates with overall survival of diffuse large B-cell lymphoma
err2014-03-22
err0
PREAI
errWan-ling Wang; Cui Yang; Xiao-lin Han; Ran Wang; Yan Huang; You-mei Zi; Jing-dong Li
err分享
err收藏
The vegetation of a New Zealand dune slack
err1987-07-01
err0
PREAI
errMartin T. Sykes; J. Bastow Wilson
err分享
err收藏
Diversity and productivity of plant communities across the Inland Northwest, USA
err2005-03-24
err0
PREAI
errMichael D. Jennings; John W. Williams; Mark R. Stromberg
err分享
err收藏
Clinical and Imaging Biomarkers Associated with Outer Retinal Atrophy Onset in Exudative Age-Related Macular Degeneration: A Real-Word Prospective Study
err2024-03-06
err0
errOAAI
errAlessandro Arrigo; Andrea Saladino; Emanuela Aragona; Costanza Barresi; Cecilia Mularoni; Francesco Bandello; Maurizio Battaglia Parodi
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容