arrow
返回

Learning Reconstructability for Drone Aerial Path Planning

delete2022-11-30
delete5
delete
OA
AI
Y
Yilin Liu
L
Liqiang Lin
Y
Yue Hu
K
Ke Xie
C
Chi‐Wing Fu
H
Hao Zhang
H
Hui Huang *
DOI:10.1145/3550454.3555433delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We introduce the first learning-based reconstructability predictor to improve view and path planning for large-scale 3D urban scene acquisition using unmanned drones. In contrast to previous heuristic approaches, our method learns a model that explicitly predicts how well a 3D urban scene will be reconstructed from a set of viewpoints. To make such a model trainable and simultaneously applicable to drone path planning, we simulate the proxy-based 3D scene reconstruction during training to set up the prediction. Specifically, the neural network we design is trained to predict the scene reconstructability as a function of the proxy geometry, a set of viewpoints, and optionally a series of scene images acquired in flight. To reconstruct a new urban scene, we first build the 3D scene proxy, then rely on the predicted reconstruction quality and uncertainty measures by our network, based off of the proxy geometry, to guide the drone path planning. We demonstrate that our data-driven reconstructability predictions are more closely correlated to the true reconstruction quality than prior heuristic measures. Further, our learned predictor can be easily integrated into existing path planners to yield improvements. Finally, we devise a new iterative view planning framework, based on the learned reconstructability, and show superior performance of the new planner when reconstructing both synthetic and real scenes.
Keyword:
Reconstructability
Aerial Path Planning
Urban Scene Reconstruction

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.8K
被引数:
3.6W

机构

S
Simon Fraser University
学者数:
1.0W
论文数: 1.0W
被引数: 1.4W
C
Chinese University of Hong Kong
学者数:
3.4W
论文数: 3.2W
被引数: 5.6W
S
shenzhen university
学者数:
4.6W
论文数: 3.4W
被引数: 72
学者 查看更多机构
引用论文

引用论文

Online coverage and inspection planning for 3D modeling
err2020-08-08
err30
PREAI
errSong, Soohwan; Kim, Daekyum; Jo, Sungho
err分享
err收藏
err分享
err收藏
Offsite Aerial Path Planning for Efficient Urban Scene Reconstruction
err2020-11-27
err38
errOAAI
errZhou, Xiaohui; Xie, Ke; Huang, Kai; Liu, Yilin; Zhou, Yang; Gong, Minglun; Huang, Hui
err分享
err收藏
Clinical outcomes and effects of treatment in older patients with idiopathic membranous nephropathy
err2019-09-01
err0
errOAAI
errYaeni Kim; Hye Eun Yoon; Byung Ha Chung; Bum Soon Choi; Cheol Whee Park; Chul Woo Yang; Yong-Soo Kim; Yu Ah Hong; Suk Young Kim; Yoon-Kyung Chang; Hyeon Seok Hwang
err分享
err收藏
err1998-01-01
err0
PREAI
errMin-Ling Chung; Fang-Yuan Lee; Li-Chun Lin; Chi-Jung Su; Min-Yen Chen; Yuh-Sheng Wen; Han-Mou Gau; Kuang-Lieh Lu
err分享
err收藏
Aerial Path Planning for Urban Scene Reconstruction: A Continuous Optimization Method and Benchmark
err2018-12-04
err46
errOAAI
errSmith, Neil; Moehrle, Nils; Goesele, Michael; Heidrich, Wolfgang
err分享
err收藏
学者 查看更多内容