.png){kind=icon}
返回
Video-based driver action recognition via hybrid spatial-temporal deep learning framework
.png){kind=icon}
PRE
AI
DOI：10.1007/s00530-020-00724-y.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Driver action recognition aims to distinguish normal driver action and some abnormal driver actions such as leaving the wheel, talking on the phone, diving with smoking, etc. For the purpose of traffic safety, studies on the computer vision technologies for driver action recognition have become especially meaningful. However, this issue is far from being solved, mainly due to the subtle variations between different driver action classes. In this paper, we present a new video-based driver action recognition approach based on the hybrid spatial-temporal deep learning framework. Specifically, we first design an encoder-decoder spatial-temporal convolutional neural network (EDSTCNN) to capture short-term spatial-temporal representation of driver actions jointly with optical flow prediction. Second, we exploit the feature refinement network (FRN) to refine the short-term driver action feature. Then, convolutional long short-term memory network (ConvLSTM) is employed for long-term spatial-temporal fusion. Finally, the fully connected neural network (FCNN) is used for final driver action recognition. In our experiment, we validate the performance of the proposed framework on our self-created datasets, including a simulated driving dataset and a real driving dataset. Extensive experimental results illustrate that the proposed hybrid spatial-temporal deep learning framework obtains the highest accuracy in multiple driver action recognition datasets (98.9% on SEU-DAR-V1 dataset and 97.0% on SEU-DAR-V2 dataset).
Keyword:
Driver action
Encoder-decoder
Spatial-temporal
Attention
Convolutional long short-term memory
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.1
论文数:
2.8K
被引数:
2.7K
机构
引用论文
Bio‐inspired routing protocol for WSN‐based smart grid applications in the context of Industry 4.0
PREAI
分享收藏
Firing characteristics of size-controlled silver–glass composite powders prepared by spray pyrolysis喷雾热解制备的尺寸受控的银-玻璃复合粉末的燃烧特性
PREAI
分享收藏Comparative study of layer by layer assembled multilayer films based on graphene oxide and reduced graphene oxide on flexible polyurethane foam: flame retardant and smoke suppression properties.png)
RSC Advances
RSC AdvancesIF0
PREAI
分享收藏
查看更多内容