arrow
返回

QoE-Driven Adaptive Streaming for Point Clouds

delete2023-01-01
delete19
PRE
AI
L
Lisha Wang
李
李成林 (Chenglin Li) *
W
Wenrui Dai
S
Shaohui Li
邹
邹君妮 (Junni Zou)
熊
熊红凯 (Hongkai Xiong)
DOI:10.1109/TMM.2022.3148585delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With increasing popularity of virtual reality and augmented reality, application of point clouds is in critical demand as it enables users to freely navigate in an immersive scene with six degrees of freedom. However, point clouds usually comprise large amounts of data, and are thus difficult to stream in bandwidth-constrained networks. It is therefore important, yet challenging, to efficiently stream the resource-intensive point clouds, such that the user's quality of experience (QoE) is guaranteed on a high-level but with a low bandwidth consumption. To this end, we propose a QoE-driven adaptive streaming approach for the tile-based point cloud transmission, to maximize the user's QoE while reducing the transmission redundancy. By exploiting the perspective projection, we specifically model the QoE of a 3D tile as a function of the bitrate of its representation, user's view frustum and spatial position, occlusion between tiles, and the resolution of rendering device. Based on this QoE model, we then formulate the QoE-optimized rate adaptation problem as a multiple-choice knapsack problem, which allocates bitrates for different tiles under a given transmission capacity. It is equivalently converted to a submodular function maximization problem subject to knapsack constraints, and solved by a practical greedy-based algorithm with a theoretical worst-case performance guarantee. The proposed algorithm is able to achieve a near-optimal performance, but with a very low computational complexity. Experimental results further demonstrate superiority of the proposed rate adaptation algorithm over existing schemes, in terms of both user's visual quality and transmission efficiency.
Keyword:
Point clouds
rate adaptation
perspective projection
submodular function maximization
MPEG G-PCC

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Emerging MPEG Standards for Point Cloud Compression
err2019-03-01
err576
errOAAI
errSchwarz, Sebastian; Preda, Marius; Baroncini, Vittorio; Budagavi, Madhukar; Cesar, Pablo; Chou, Philip A.; Cohen, Robert A.; Krivokuca, Maja; Lasserre, Sebastien; Li, Zhu; Llach, Joan; Mammou, Khaled; Mekuria, Rufael; Nakagami, Ohji; Siahaan, Ernestasia; Tabatabai, Ali; Tourapis, Alexis M.; Zakharchenko, Vladyslav
err分享
err收藏
err分享
err收藏
The β-Amyloid Model of Alzheimer’s Disease
err1997-01-01
err0
PREAI
errCarl W. Cotman; David H. Cribbs; Aileen J. Anderson
err分享
err收藏
学者 查看更多内容