.png){kind=icon}
返回
Driver intention prediction based on multi-dimensional cross-modality information interaction
.png){kind=icon}
OA
AI
DOI：10.1007/s00530-024-01282-3.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Driver intention prediction allows drivers to perceive possible dangers in the fastest time and has become one of the most important research topics in the field of self-driving in recent years. In this study, we propose a driver intention prediction method based on multi-dimensional cross-modality information interaction. First, an efficient video recognition network is designed to extract channel-temporal features of in-side (driver) and out-side (road) videos, respectively, in which we design a cross-modality channel-spatial weight mechanism to achieve information interaction between the two feature extraction networks corresponding, respectively, to the two modalities, and we also introduce a contrastive learning module by which we force the two feature extraction networks to enhance structural knowledge interaction. Then, the obtained representations of in- and outside videos are fused using a ResLayer-based module to get a preliminary prediction which is then corrected by incorporating the GPS information to obtain a final decision. Besides, we employ a multi-task framework to train the entire network. We validate the proposed method on the public dataset Brain4Car, and the results show that the proposed method achieves competitive results in accuracy while balancing performance and computation.
Keyword:
Driver intention prediction
Self-driving
Multimodal learning
Contrastive learning
Deep neural networks
期刊
IF:
3.1
论文数:
2.8K
被引数:
2.7K
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
.png){kind=icon}
PREAI
分享收藏
DCMNet: Discriminant and cross-modality network for RGB-D salient object detectionDCMNet: 用于rgb-d显著目标检测的判别和交叉模态网络
PREAI
分享收藏
查看更多内容