arrow
返回

PU-Dense: Sparse Tensor-Based Point Cloud Geometry Upsampling

delete2022-01-01
delete25
delete
OA
AI
A
Anique Akhtar *
朱
朱理 (Li, Zhu)
G
Geert Van der Auwera
李
李莉 (Li Li)
J
Jianle Chen
DOI:10.1109/TIP.2022.3180904delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to the increased popularity of augmented and virtual reality experiences, the interest in capturing high-resolution real-world point clouds has never been higher. Loss of details and irregularities in point cloud geometry can occur during the capturing, processing, and compression pipeline. It is essential to address these challenges by being able to upsample a low Level-of-Detail (LoD) point cloud into a high LoD point cloud. Current upsampling methods suffer from several weaknesses in handling point cloud upsampling, especially in dense real-world photo-realistic point clouds. In this paper, we present a novel geometry upsampling technique, PU-Dense, which can process a diverse set of point clouds including synthetic mesh-based point clouds, real-world high-resolution point clouds, real-world indoor LiDAR scanned objects, as well as outdoor dynamically acquired LiDAR-based point clouds. PU-Dense employs a 3D multiscale architecture using sparse convolutional networks that hierarchically reconstruct an upsampled point cloud geometry via progressive rescaling and multiscale feature extraction. The framework employs a UNet type architecture that downscales the point cloud to a bottleneck and then upscales it to a higher level-of-detail (LoD) point cloud. PU-Dense introduces a novel Feature Extraction Unit that incorporates multiscale spatial learning by employing filters at multiple sampling rates and receptive fields. The architecture is memory efficient and is driven by a binary voxel occupancy classification loss that allows it to process high-resolution dense point clouds with millions of points during inference time. Qualitative and quantitative experimental results show that our method significantly outperforms the state-of-the-art approaches by a large margin while having much lower inference time complexity. We further test our dataset on high-resolution photo-realistic datasets. In addition, our method can handle noisy data well. We further show that our approach is memory efficient compared to the state-of-the-art methods.
Keyword:
Point cloud compression
Three-dimensional displays
Laser radar
Geometry
Feature extraction
Sensors
Deep learning
Point cloud
upsampling

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
University of Missouri System 封面图
University of Missouri System
学者数:
3.0W
论文数: 2.7W
被引数: 75
引用论文

引用论文

Continuous Projection for Fast L1 Reconstruction
err2014-07-27
err93
PREAI
errPreiner, Reinhold; Mattausch, Oliver; Arikan, Murat; Pajarola, Renato; Wimmer, Michael
err分享
err收藏
err分享
err收藏
Urban residential water and electricity consumption behavior: A systematic literature review
err2023-08-01
err0
PREAI
errWalter Salas-Zapata; Lorena Hoyos-Medina; Diana Mejía-Durango
err分享
err收藏
Emerging MPEG Standards for Point Cloud Compression
err2019-03-01
err576
errOAAI
errSchwarz, Sebastian; Preda, Marius; Baroncini, Vittorio; Budagavi, Madhukar; Cesar, Pablo; Chou, Philip A.; Cohen, Robert A.; Krivokuca, Maja; Lasserre, Sebastien; Li, Zhu; Llach, Joan; Mammou, Khaled; Mekuria, Rufael; Nakagami, Ohji; Siahaan, Ernestasia; Tabatabai, Ali; Tourapis, Alexis M.; Zakharchenko, Vladyslav
err分享
err收藏
General pediatrics: A study of practice in the mid-1960's
err1968-08-01
err0
PREAI
errSamuel J. Hessel; Robert J. Haggerty
err分享
err收藏
Heat waves and adaptation: A global systematic review
err2023-08-01
err0
PREAI
errMaryam Kiarsi; Mohammadreza Amiresmaili; Mohammad Reza Mahmoodi; Hojjat Farahmandnia; Nouzar Nakhaee; Armin Zareiyan; Hamidreza Aghababaeian
err分享
err收藏
Point Cloud Denoising via Feature Graph Laplacian Regularization
err2020-01-01
err63
PREAI
errDinesh, Chinthaka; Cheung, Gene; Bajic, Ivan, V
err分享
err收藏
学者 查看更多内容