arrow
Return

OBMO: One Bounding Box Multiple Objects for Monocular 3D Object Detection

delete2023-01-01
delete6
delete
OA
AI
C
Chenxi Huang
T
Tong He
H
Haidong Ren
W
Wenxiao Wang
B
Binbin Lin *
D
Deng Cai
DOI:10.1109/TIP.2023.3333225delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Compared to typical multi-sensor systems, monocular 3D object detection has attracted much attention due to its simple configuration. However, there is still a significant gap between LiDAR-based and monocular-based methods. In this paper, we find that the ill-posed nature of monocular imagery can lead to depth ambiguity. Specifically, objects with different depths can appear with the same bounding boxes and similar visual features in the 2D image. Unfortunately, the network cannot accurately distinguish different depths from such non-discriminative visual features, resulting in unstable depth training. To facilitate depth learning, we propose a simple yet effective plug-and-play module, One Bounding Box Multiple Objects (OBMO). Concretely, we add a set of suitable pseudo labels by shifting the 3D bounding box along the viewing frustum. To constrain the pseudo-3D labels to be reasonable, we carefully design two label scoring strategies to represent their quality. In contrast to the original hard depth labels, such soft pseudo labels with quality scores allow the network to learn a reasonable depth range, boosting training stability and thus improving final performance. Extensive experiments on KITTI and Waymo benchmarks show that our method significantly improves state-of-the-art monocular 3D detectors by a significant margin (The improvements under the moderate setting on KITTI validation set are 1.82 similar to 10.91% mAP in BEV and 1.18 similar to 9.36% mAP in 3D). Codes have been released at https://github.com/mrsempress/OBMO.
Keywords:
3D object detection
monocular images
depth ambiguity
camera project principles

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

S
Shanghai Artificial Intelligence Laboratory
Scholars:
470
Papers: 258
Citations: 765
Z
zhejiang university
Scholars:
17.5W
Papers: 12.0W
Citations: 152