.png){kind=icon}
.png){kind=icon}
Return
VPU: A Video-Based Point Cloud Upsampling Framework
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2022.3166627.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
In this work, we propose a new patch-based framework called VPU for the video-based point cloud upsampling task by effectively exploiting temporal dependency among multiple consecutive point cloud frames, in which each frame consists of a set of unordered, sparse and irregular 3D points. Rather than adopting the sophisticated motion estimation strategy in video analysis, we propose a new spatio-temporal aggregation (STA) module to effectively extract, align and aggregate rich local geometric clues from consecutive frames at the feature level. By more reliably summarizing spatio-temporally consistent and complementary knowledge from multiple frames in the resultant local structural features, our method better infers the local geometry distributions at the current frame. In addition, our STA module can be readily incorporated with various existing single frame-based point upsampling methods (e.g., PU-Net, MPU, PU-GAN and PU-GCN). Comprehensive experiments on multiple point cloud sequence datasets demonstrate our video-based point cloud upsampling framework achieves substantial performance improvement over its single frame-based counterparts.
Keywords:
Point cloud compression
Three-dimensional displays
Feature extraction
Task analysis
Graphics processing units
Image reconstruction
Cloud computing
Point cloud sequence
point cloud upsampling
spatial-temporal aggregation
Journal
IF:
13.7
Papers:
1.0W
Citations:
8.4W