arrow
Return

Efficient Vehicular Collaborative Perception Based on Saptial-Temporal Feature Compression

delete2024-11-01
delete0
PRE
AI
J
Jingyu Zhang
K
Kun Yang
H
Hanqi Wang
P
Peng Sun
宋梁 (Liang Song) *
DOI:10.1109/TVT.2024.3403263delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In collaborative perception, autonomous vehicles with limited perception capabilities can communicate with each other to achieve a more holographic and effective perception result. Real-world communication systems, however, are usually constrained by wireless communication resources or reliability and cannot handle the enormous real-time data transmissions to support the delay-sensitive collaborative perception. To resolve this issue, we propose an efficient vehicular Collaborative Perception method based on Spatial-temporal feature Compression (CPSC) that exploits the trade-off between perception performance and bandwidth consumption. It performs feature-level compression by focusing on critical regions of perceptual information in the spatial-temporal domain and adapts traffic according to network conditions. To the best of our knowledge, this paper presents the first work where temporal feature redundancy is considered for enhancing the efficiency of collaborative perception. To thoroughly evaluate CPSC, we conduct extensive experiments of collaborative 3D object detection tasks on the real-world dataset DAIR-V2X and the simulated dataset OPV2V. The results show that CPSC outperforms the SOTA collaborative perception methods by 2.91% for AP@0.7 in OPV2V dataset and 1.71% for AP@0.5 in DAIR-V2X dataset. Meanwhile, CPSC attains a communication volume reduction of more than 10 times while consistently outperforming the previous SOTA method.
Keywords:
Collaboration
Feature extraction
Bandwidth
Data communication
Autonomous vehicles
Wireless communication
Vehicle-to-everything
Internet of Vehicles
Cooperative Perception
Autonomous Vehicles
Object Detection
Data Compression

Journal

IEEE Transactions on Vehicular Technology cover
IEEE Transactions on Vehicular Technology
IF:
7.1
Papers:
1.8W
Citations:
6.6W

Organization

F
fudan university
Scholars:
11.7W
Papers: 7.7W
Citations: 121