arrow
返回

Inter-Frame Compression for Dynamic Point Cloud Geometry Coding

delete2024-01-01
delete5
delete
OA
AI
A
Anique Akhtar *
朱
朱理 (Li, Zhu)
G
Geert Van der Auwera
DOI:10.1109/TIP.2023.3343096delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Efficient point cloud compression is essential for applications like virtual and mixed reality, autonomous driving, and cultural heritage. This paper proposes a deep learning-based inter-frame encoding scheme for dynamic point cloud geometry compression. We propose a lossy geometry compression scheme that predicts the latent representation of the current frame using the previous frame by employing a novel feature space inter-prediction network. The proposed network utilizes sparse convolutions with hierarchical multiscale 3D feature learning to encode the current frame using the previous frame. The proposed method introduces a novel predictor network for motion compensation in the feature domain to map the latent representation of the previous frame to the coordinates of the current frame to predict the current frame's feature embedding. The framework transmits the residual of the predicted features and the actual features by compressing them using a learned probabilistic factorized entropy model. At the receiver, the decoder hierarchically reconstructs the current frame by progressively rescaling the feature embedding. The proposed framework is compared to the state-of-the-art Video-based Point Cloud Compression (V-PCC) and Geometry-based Point Cloud Compression (G-PCC) schemes standardized by the Moving Picture Experts Group (MPEG). The proposed method achieves more than 88% BD-Rate (Bjontegaard Delta Rate) reduction against G-PCCv20 Octree, more than 56% BD-Rate savings against G-PCCv20 Trisoup, more than 62% BD-Rate reduction against V-PCC intra-frame encoding mode, and more than 52% BD-Rate savings against V-PCC P-frame-based inter-frame encoding mode using HEVC. These significant performance gains are cross-checked and verified in the MPEG working group.
Keyword:
Point cloud
compression
PCC
deep learning
neural network

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

Q
qualcomm
学者数:
782
论文数: 646
被引数: 1
University of Missouri System 封面图
University of Missouri System
学者数:
3.0W
论文数: 2.7W
被引数: 75
引用论文

引用论文

Emerging MPEG Standards for Point Cloud Compression
err2019-03-01
err576
errOAAI
errSchwarz, Sebastian; Preda, Marius; Baroncini, Vittorio; Budagavi, Madhukar; Cesar, Pablo; Chou, Philip A.; Cohen, Robert A.; Krivokuca, Maja; Lasserre, Sebastien; Li, Zhu; Llach, Joan; Mammou, Khaled; Mekuria, Rufael; Nakagami, Ohji; Siahaan, Ernestasia; Tabatabai, Ali; Tourapis, Alexis M.; Zakharchenko, Vladyslav
err分享
err收藏
End-to-End Optimized ROI Image Compression端到端优化的ROI图像压缩
err2020-01-01
err62
PREAI
errCai, Chunlei; Chen, Li; Zhang, Xiaoyun; Gao, Zhiyong
err分享
err收藏
Adaptive Deep Learning-Based Point Cloud Geometry Coding
err2021-02-01
err61
PREAI
errGuarda, Andre F. R.; Rodrigues, Nuno M. M.; Pereira, Fernando
err分享
err收藏
学者 查看更多内容