arrow
Return

Multi-Space Point Geometry Compression With Progressive Relation-Aware Transformer

delete2024-01-01
delete0
PRE
AI
W
Wenxiang Shen
B
Baoye Zhang
徐
徐浩 (Hao Xu)
X
X. Li
J
Jun Wu *
DOI:10.1109/TMM.2024.3384057delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep network-based point cloud geometry compression is becoming more crucial and attractive due to constantly expanding 3D applications. The current strategy employing holistic point clouds as input imposes limitations on the compressed point cloud size and results in the loss of local geometry information, simplifying the repetition of local point cloud patterns. Nevertheless, employing point cloud patches as input results in a fresh set of erroneous points within the spliced point cloud. This occurrence can be attributed to the loss of global information and the relationship among the point cloud patches. Hence, this paper introduces a novel framework for progressive downsampling point cloud compression that follows the principles of two distinct methodologies. Our strategy still uses the autoencoder structure. Specifically, the encoder reduces the point cloud size and learns features incorporating local patch structure information and global semantic information. At the same time, the decoder upsamples the quantized and entropy-encoded features to reconstruct the original point cloud. More specifically, the geometrical details inside the patch and the relationship between patches are encoded to obtain the point cloud's global semantic and local geometry information. Concurrently, the computational burden is reduced by partitioning the complete point cloud input into segments and conducting continuous downsampling. Furthermore, we introduced an attention-based point cloud deconvolution module to address the localized repeating concentrations in reconstructed point clouds resulting from linear interpolation. This module samples the parent node and its neighboring relationships in the multi-space domain to improve the characteristics of the parent nodes to be sampled. It then uses the deconvolution to create sub-node characteristics that are more varied than the linear interpolation. Empirical evidence demonstrates that the proposed methodology achieves a effective equilibrium between the compression quality and ratio.
Keywords:
Point cloud compression
Transformers
Three-dimensional displays
Decoding
Geometry
Entropy
Encoding
Cross-attention
point cloud geometry compression
self-attention
transformer

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.7K
Citations:
2.4W

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
T
tongji university
Scholars:
7.9W
Papers: 6.0W
Citations: 98
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Clinical manifestations and treatment outcomes of syphilitic uveitis in HIV-negative patients in China
err2017-10-01
err0
errOAAI
errJiang Zhu; Yuan Jiang; Yewen Shi; Bo Zheng; Zhiguo Xu; Wei Jia
errShare
errSave
PCT: Point cloud transformer
err2021-06-01
err1.0K
errOAAI
errGuo, Meng-Hao; Cai, Jun-Xiong; Liu, Zheng-Ning; Mu, Tai-Jiang; Martin, Ralph R.; Hu, Shi-Min
errShare
errSave
Impurity effects on ionic-liquid-based supercapacitors
err2016-12-27
err0
errOAAI
errKun Liu; Cheng Lian; Douglas Henderson; Jianzhong Wu
errShare
errSave
Urban residential water and electricity consumption behavior: A systematic literature review
err2023-08-01
err0
PREAI
errWalter Salas-Zapata; Lorena Hoyos-Medina; Diana Mejía-Durango
errShare
errSave
Genome-wide identification and analysis of LOX genes in soybean cultivar “Zhonghuang 13”
err2022-10-07
err0
errOAAI
errJing Zhang; Cheungchuk Ng; Yan Jiang; Xianxu Wang; Shaodong Wang; Sui Wang
errShare
errSave
Emerging MPEG Standards for Point Cloud Compression
err2019-03-01
err576
errOAAI
errSchwarz, Sebastian; Preda, Marius; Baroncini, Vittorio; Budagavi, Madhukar; Cesar, Pablo; Chou, Philip A.; Cohen, Robert A.; Krivokuca, Maja; Lasserre, Sebastien; Li, Zhu; Llach, Joan; Mammou, Khaled; Mekuria, Rufael; Nakagami, Ohji; Siahaan, Ernestasia; Tabatabai, Ali; Tourapis, Alexis M.; Zakharchenko, Vladyslav
errShare
errSave
Joint hypermobility and oligoarticular juvenile idiopathic arthritis: What relationship?
err2017-01-04
err0
PREAI
errVanessa Cecchin; Francesca Sperotto; Marta Balzarin; Fabio Vittadello; Giorgia Martini; Francesco Zulian
errShare
errSave
errShare
errSave
researcher View more