arrow
Return

Multi-view aggregation transformer for no-reference point cloud quality assessment

delete2023-07-01
delete14
PRE
AI
B
Baoyang Mu
X
Xiongli Chai
Q
Qiang Liu
H
Hangwei Chen
Q
Qiuping Jiang
DOI:10.1016/j.displa.2023.102450delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the increasing maturity of 3D point cloud acquisition, storage, and transmission technologies, a large number of distorted point clouds without original reference exist in practical applications. Hence, it is necessary to design a no-reference point cloud quality assessment (PCQA) for point cloud systems. However, the existing no-reference PCQA metrics ignore the content differences and positional context among the projected images. For this, we propose a Multi-View Aggregation Transformer (MVAT) with two different fusion modules to extract the comprehensive feature representation of PCQA. Specifically, considering the content differences of different projected images, we first design a Content Fusion Module (CFM) to fuse multiple projected image features by adaptive weighting. Then, we design a Bidirectional Context Fusion Module (BCFM) to extract context features for reflecting the contextual relationship among projected images. Finally, we joint the above two fusion modules via Content-Position Fusion Module (CPFM) to fully mine the feature representation of point clouds. Experi-mental results show that our MVAT can achieve comparable or better performance than state-of-the-art metrics on three open point cloud datasets.
Keywords:
No-reference PCQA
Bidirectional context fusion
Multi-view aggregation
Transformer

Journal

Displays cover
Displays
IF:
3.4
Papers:
2.2K
Citations:
3.2K

Organization

N
Ningbo University
Scholars:
2.6W
Papers: 1.8W
Citations: 2.4W