arrow
Return

Graph-Based Depth Denoising & Dequantization for Point Cloud Enhancement

delete2022-01-01
delete3
delete
OA
AI
X
Xue Zhang
G
Gene Cheung *
J
Jiahao Pang
Y
Yash Sanghvi
A
Abhiram Gnanasambandam
S
Stanley H. Chan
DOI:10.1109/TIP.2022.3214077delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A 3D point cloud is typically constructed from depth measurements acquired by sensors at one or more viewpoints. The measurements suffer from both quantization and noise corruption. To improve quality, previous works denoise a point cloud a posteriori after projecting the imperfect depth data onto 3D space. Instead, we enhance depth measurements directly on the sensed images a priori, before synthesizing a 3D point cloud. By enhancing near the physical sensing process, we tailor our optimization to our depth formation model before subsequent processing steps that obscure measurement errors. Specifically, we model depth formation as a combined process of signal-dependent noise addition and non-uniform log-based quantization. The designed model is validated (with parameters fitted) using collected empirical data from a representative depth sensor. To enhance each pixel row in a depth image, we first encode intra-view similarities between available row pixels as edge weights via feature graph learning. We next establish inter-view similarities with another rectified depth image via viewpoint mapping and sparse linear interpolation. This leads to a maximum a posteriori (MAP) graph filtering objective that is convex and differentiable. We minimize the objective efficiently using accelerated gradient descent (AGD), where the optimal step size is approximated via Gershgorin circle theorem (GCT). Experiments show that our method significantly outperformed recent point cloud denoising schemes and state-of-the-art image denoising schemes in two established point cloud quality metrics.
Keywords:
Sensors
Noise reduction
Three-dimensional displays
Point cloud compression
Quantization (signal)
Noise measurement
Image sensors
3D point cloud
depth sensing
signal-dependent noise
non-uniform quantization
graph signal processing

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

I
interdigital
Scholars:
145
Papers: 169
Citations: 0
Purdue University System cover
Purdue University System
Scholars:
4.0W
Papers: 3.6W
Citations: 66
Y
york university - canada
Scholars:
8.3K
Papers: 9.0K
Citations: 10
researcher View more organizations
Cited Papers

Cited Papers

New MT2 Melatonin Receptor-Selective Ligands: Agonists and Partial Agonists
err2017-06-23
err0
errOAAI
errJean Boutin; Anne Bonnaud; Chantal Brasseur; Olivier Bruno; Nolwenn Lepretre; Peter Oosting; Sophie Coumailleau; Philippe Delagrange; Olivier Nosjean; Céline Legros
errShare
errSave
Retromer localizes to autophagosomes during HCV replication
err2017-04-13
err0
errOAAI
errPeiqi Yin; Zhi Hong; Leiliang Zhang; Youyang Ke
errShare
errSave
Robust moving least-squares fitting with sharp features
err2005-07-01
err410
PREAI
errFleishman, S; Cohen-Or, D; Silva, CT
errShare
errSave
Region-Aware 3-D Warping for DIBR
err2016-06-01
err24
PREAI
errJin, Jian; Wang, Anhong; Zhao, Yao; Lin, Chunyu; Zeng, Bing
errShare
errSave
Developmental Changes of the 26 S Proteasome in Abdominal Intersegmental Muscles of Manduca sexta during Programmed Cell Death
err1995-01-01
err0
errOAAI
errStuart E. Reynolds; Michael A. Billett; Colin Gordon; Laurence Colleaux; Peter M. Kloetzel; Keiji Tanaka; Simon P. Dawson; Jane E. Arnold; Nicholas J. Mayer; R. John Mayer
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more