arrow
Return

Monocular 3D Object Detection Utilizing Auxiliary Learning With Deformable Convolution

delete2024-03-01
delete0
PRE
AI
J
Jeng-Lun Shieh
M
Muhamad Amirul Haq
S
Shanq-Jang Ruan *
DOI:10.1109/TITS.2023.3319556delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In autonomous driving systems, the monocular 3D object detection algorithm is a crucial component. The safety of autonomous vehicles heavily depends on a well-designed detection system. Therefore, developing a robust and efficient 3D object detection algorithm is a major goal for institutes and researchers. Having a 3D sense is essential in autonomous vehicles and robotics, as it allows the system to understand its surroundings and react accordingly. Compared with stereo-based and Lidar-based methods, monocular 3D Object detection is a challenging task as it only utilizes 2D information to generate complex 3D features, making it low-cost, less computationally intensive, and with great potential. However, the performance of monocular methods is impaired due to the lack of depth information. In this paper, we propose a simple, end-to-end, and effective network for monocular 3D object detection without the use of external training data. Our work is inspired by auxiliary learning, in which we use a robust feature extractor as our backbone and multiple regression heads to learn auxiliary knowledge. These auxiliary regression heads will be discarded after training for improved inference efficiency, allowing us to take advantage of auxiliary learning and enabling the model to learn critical information more conceptually. The proposed method achieves 17.28% and 20.10% for the moderate level of the Car category on the KITTI benchmark test set and validation set, respectively, which outperforms the previous monocular 3D object detection approaches.
Keywords:
Three-dimensional displays
Object detection
Solid modeling
Feature extraction
Training
Computational modeling
Task analysis
3D object detection
monocular camera
driving scene understanding
auxiliary learning
deep learning

Journal

IEEE Transactions on Intelligent Transportation Systems cover
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
Papers:
9.5K
Citations:
6.3W

Organization

N
national taiwan university of science & technology
Scholars:
8.8K
Papers: 8.7K
Citations: 9