arrow
Return

Pillar Attention Encoder for Adaptive Cooperative Perception

delete2024-07-15
delete1
PRE
AI
Z
Zhengwei Bai *
G
Guoyuan Wu
M
Matthew Barth
H
Hang Qiu
Y
Yongkang Liu
E
Emrah Akin Sisbot
K
Kentaro Oguchi
DOI:10.1109/JIOT.2024.3390552delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Interest in cooperative perception (CP) is growing quickly due to its remarkable performance in improving perception capabilities for connected and automated vehicles. This improvement is crucial, especially for automated driving scenarios in which perception performance is one of the main bottlenecks to the development of safety and efficiency. However, current CP methods typically assume that all collaborating vehicles have enough communication bandwidth to share all features with an identical spatial size, which is impractical for real-world scenarios. In this article, we propose adaptive CP, a new CP framework that is not limited by the aforementioned assumptions, aiming to enable CP under more realistic and challenging conditions. To support this, a novel feature encoder is proposed and named pillar attention encoder. A pillar attention mechanism is designed to extract the feature data while considering its significance for the perception task. An adaptive feature filter is proposed to adjust the size of the feature data for sharing by considering the importance value of the feature. Experiments are conducted for cooperative object detection from multiple vehicle-based and infrastructure-based LiDAR sensors under various communication conditions. Results demonstrate that our method can successfully handle dynamic communication conditions and improve the mean average precision by 10.18% when compared with the state-of-the-art feature encoder.
Keywords:
Feature extraction
Sensors
Data mining
Three-dimensional displays
Shape
Bandwidth
Adaptive systems
3-D object detection
connected and automated vehicles
cooperative perception (CP)
feature filtering
transformer

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

U
university of california riverside
Scholars:
1.1W
Papers: 8.3K
Citations: 16
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K