arrow
返回

Advanced 3D Motion Prediction for Video-Based Dynamic Point Cloud Compression

delete2020-01-01
delete64
PRE
AI
李
李莉 (Li Li)
朱
朱理 (Li, Zhu) *
V
Vladyslav Zakharchenko
J
Jianle Chen
李
李厚强 (Houqiang Li)
DOI:10.1109/TIP.2019.2931621delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Point cloud-based immersive media representation format has provided many opportunities for extended reality applications and has become widely used in volumetric content capturing scenarios. The high data rate of the point cloud is one of the key problems preventing the adoption of this media format. MPEG Immersive media working group (MPEG-I) aims to create a point cloud compression methodology relying on the existing video coding hardware implementations to solve this problem. However, in the scope of the state-of-the-art video-based dynamic point cloud compression (V-PCC) standard under MPEG-I, the intrinsic 3D object's motion continuity is destroyed by the 2D projections, resulting in a significant loss of inter prediction coding efficiency. In this paper, we first propose a general model utilizing the 3D motion and 3D to 2D correspondence to calculate the 2D motion vector (MV). Then, under the V-PCC, we propose a geometry-based method using the accurate 3D reconstructed geometry from the 2D geometry video to estimate the 2D MV in the 2D attribute video. In addition, we propose an auxiliary-information-based method using the coarse 3D reconstructed geometry provided by the auxiliary information to estimate the 2D MV in both the 2D geometry and attribute videos. Furthermore, we provide the following two ways to use the estimated 2D MV to improve coding efficiency. The first one is normative. We propose adding the estimated MV into the advanced MV candidate list and find a better MV predictor for each prediction unit (PU). The second one is non-normative. We propose applying the estimated MV as an additional candidate of the centers for motion estimation. We implement the proposed algorithms in the V-PCC reference software. Experimental results show that the proposed methods present significant coding gains compared with the current state-of-the-art motion prediction algorithm.
Keyword:
Three-dimensional displays
Two dimensional displays
Image coding
Geometry
Video compression
Dynamics
Transform coding
Auxiliary information
dynamic point cloud
High Efficiency Video Coding
point cloud compression
3D motion prediction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
university of missouri kansas city
学者数:
3.9K
论文数: 3.3K
被引数: 3
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
University of Missouri System 封面图
University of Missouri System
学者数:
3.0W
论文数: 2.7W
被引数: 75
学者 查看更多机构
引用论文

引用论文

Emerging MPEG Standards for Point Cloud Compression
err2019-03-01
err576
errOAAI
errSchwarz, Sebastian; Preda, Marius; Baroncini, Vittorio; Budagavi, Madhukar; Cesar, Pablo; Chou, Philip A.; Cohen, Robert A.; Krivokuca, Maja; Lasserre, Sebastien; Li, Zhu; Llach, Joan; Mammou, Khaled; Mekuria, Rufael; Nakagami, Ohji; Siahaan, Ernestasia; Tabatabai, Ali; Tourapis, Alexis M.; Zakharchenko, Vladyslav
err分享
err收藏
Motion Vector Coding in the HEVC Standard
err2013-12-01
err63
PREAI
errLin, Jian-Liang; Chen, Yi-Wen; Huang, Yu-Wen; Lei, Shaw-Min
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容