arrow
Return

AADS: Augmented autonomous driving simulation using data-driven algorithms

delete2019-03-13
delete116
delete
OA
AI
W
Wei Li *
C
Chengwei Pan
R
Rong Zhang
J
Jiaping Ren
Y
Yuexin Ma
J
Jin Fang
F
Feilong Yan
庚琦川 (Qichuan Geng)
X
Xinyu Huang
H
Hengfeng Gong
W
Wenbin Xu
汪国平 (Guoping Wang)
D
Dinesh Manocha *
杨睿刚 (Ruigang Yang) *
DOI:10.1126/scirobotics.aaw0863delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Simulation systems have become essential to the development and validation of autonomous driving (AD) technologies. The prevailing state-of-the-art approach for simulation uses game engines or high-fidelity computer graphics (CG) models to create driving scenarios. However, creating CG models and vehicle movements (the assets for simulation) remain manual tasks that can be costly and time consuming. In addition, CG images still lack the richness and authenticity of real-world images, and using CG images for training leads to degraded performance. Here, we present our augmented autonomous driving simulation (AADS). Our formulation augmented real-world pictures with a simulated traffic flow to create photorealistic simulation images and renderings. More specifically, we used LiDAR and cameras to scan street scenes. From the acquired trajectory data, we generated plausible traffic flows for cars and pedestrians and composed them into the background. The composite images could be resynthesized with different viewpoints and sensor models (camera or LiDAR). The resulting images are photorealistic, fully annotated, and ready for training and testing of AD systems from perception to planning. We explain our system design and validate our algorithms with a number of AD tasks from detection to segmentation and predictions. Compared with traditional approaches, our method offers scalability and realism. Scalability is particularly important for AD simulations, and we believe that real-world complexity and diversity cannot be realistically captured in a virtual environment. Our augmented approach combines the flexibility of a virtual environment (e.g., vehicle movements) with the richness of the real world to allow effective simulation.
Keywords:
OF-THE-ART
IMAGE
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Science Robotics cover
Science Robotics
IF:
27.5
Papers:
919
Citations:
1.4W

Organization

B
Beihang University
Scholars:
5.1W
Papers: 4.1W
Citations: 37
University System of Maryland cover
University System of Maryland
Scholars:
6.4W
Papers: 5.6W
Citations: 113
P
peking university
Scholars:
11.7W
Papers: 8.7W
Citations: 146
B
baidu
Scholars:
577
Papers: 470
Citations: 1
Z
zhejiang university
Scholars:
17.4W
Papers: 12.0W
Citations: 152
researcher View more organizations