arrow
返回

Learning Driver-Irrelevant Features for Generalizable Driver Behavior Recognition

delete2024-10-01
delete1
PRE
AI
H
Hang Gao
M
Mengting Hu
刘熠 封面图
刘熠 (Yi Liu) *
DOI:10.1109/TITS.2024.3396640delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Traffic accidents caused by driver distractions have seriously endangered public safety, with driver distractions typically stemming from behaviors beyond safe driving. Recently, vision-based driver behavior recognition has attracted much attention, achieving great success with deep learning-based schemes. However, the generalization ability of these models in real-world scenarios remains unsatisfactory. In this paper, we conduct an in-depth investigation into the underlying causes of this unsatisfactory generalization and conclude that the behavior features extracted by convolutional neural networks are intertwined with driver identity features. Based on this discovery, we propose a feature decomposition (FD) framework to disentangle these two types of features. The separated behavior features, referred to as driver-irrelevant behavior features, are subsequently leveraged for behavior recognition. Moreover, we introduce a co-training strategy to optimize the FD framework. This strategy enables behavior features and identity features to provide mutual auxiliary signals and encourages each other to drop the information that do not belong to them, so that the learned behavior features can be driver-irrelevant. Rigorous experiments are conducted on two widely-studied datasets, yielding results that demonstrate the superior performance of our framework and its improved generalization capabilities. Importantly, our framework's fast inference capabilities make it highly suitable for real-world scenarios. Codes are released at https://github.com/gaohangcodes/ LearningDriverIrrelevantFeatures4DBR.
Keyword:
Training
Vehicles
Feature extraction
Data augmentation
Data models
Testing
Public security
Generalization
driver distraction
behavior recognition
feature decomposition
co-training

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
N
nankai university
学者数:
4.8W
论文数: 3.3W
被引数: 74
引用论文

引用论文

err分享
err收藏
err分享
err收藏
A Phase I-II multicenter trial with Avelumab plus autologous dendritic cell vaccine in pre-treated mismatch repair-proficient (MSS) metastatic colorectal cancer patients; GEMCAD 1602 study
err2022-09-09
err0
errOAAI
errMarta Español-Rego; Carlos Fernández-Martos; Elena Elez; Carles Foguet; Leire Pedrosa; Nuria Rodríguez; Ana Ruiz-Casado; Estela Pineda; Joan Cid; Raquel Cabezón; Helena Oliveres; Miquel Lozano; Angels Ginés; Angeles García-Criado; Juan Ramon Ayuso; Mario Pagés; Miriam Cuatrecasas; Ferràn Torres; Timothy Thomson; Marta Cascante; Daniel Benítez-Ribas; Joan Maurel
err分享
err收藏
A dynamic task assignment model for aviation emergency rescue based on multi-agent reinforcement learning
err2023-09-01
err3
errOAAI
errShen, Yang; Wang, Xianbing; Wang, Huajun; Guo, Yongchen; Chen, Xiang; Han, Jiaqi
err分享
err收藏
Soft Spatial Attention-Based Multimodal Driver Action Recognition Using Deep Learning
err2021-01-15
err38
PREAI
errJegham, Imen; Ben Khalifa, Anouar; Alouani, Ihsen; Mahjoub, Mohamed Ali
err分享
err收藏
Participatory urban planning in the digital era
err2020-02-18
err0
PREAI
errAija Staffans; Maarit Kahila-Tani; Marketta Kyttä
err分享
err收藏
学者 查看更多内容