arrow
Return

RPCC: Rectified Pearson Correlation Coefficient for Radiance Fields Optimization

delete2025-01-01
delete0
PRE
AI
J
Jun Peng
C
Chunyi Chen
DOI:10.1109/LSP.2025.3578913delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Neural radiance fields (NeRF) and its variants have achieved remarkable success for novel view synthesis. Most existing radiance field models utilize the mean squared error (MSE) as the photometric loss, which is prone to resulting in blurriness and geometry inaccuracy, especially for sparse views. Instead of the pixel-wise loss, we introduce the Pearson correlation coefficient (PCC) for constructing a new photometric loss from the perspective of linear correlation. Due to the relativeness of PCC, we rectify PCC to absolutize it. To be specific, we relax the denominator of PCC based on the inequality of arithmetic and geometric means to enforce unit scale, and add an extra modulation factor to further enforce zero location. The experimental results show the proposed loss is significantly better than the MSE loss, e.g. the peak signal-to-noise ratio (PSNR) increasing by 186% for TensoRF on Replica dataset, and 3 $\sim$ 5 dB for DVGO at scenes from Tanks and Temples dataset with sparse views setting.
Keywords:
Neural radiance fields
novel view synthesis
Pearson correlation coefficient
photometric loss

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

C
changchun university of science and technology
Scholars:
2.0K
Papers: 599
Citations: 1
Cited Papers

Cited Papers

Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields
err2023-10-01
err0
errOAAI
errJonathan T. Barron; Ben Mildenhall; Dor Verbin; Pratul P. Srinivasan; Peter Hedman
errShare
errSave
Point-NeRF: Point-based Neural Radiance Fields
err2022-06-01
err0
errOAAI
errQiangeng Xu; Zexiang Xu; Julien Philip; Sai Bi; Zhixin Shu; Kalyan Sunkavalli; Ulrich Neumann
errShare
errSave
Ray tracing volume densities
err1984-01-01
err0
PREAI
errJames T. Kajiya; Brian P Von Herzen
errShare
errSave
Tanks and Temples: Benchmarking Large-Scale Scene Reconstruction
err2017-07-20
err636
PREAI
errKnapitsch, Arno; Park, Jaesik; Zhou, Qian-Yi; Koltun, Vladlen
errShare
errSave
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
err2021-10-01
err0
errOAAI
errJonathan T. Barron; Ben Mildenhall; Matthew Tancik; Peter Hedman; Ricardo Martin-Brualla; Pratul P. Srinivasan
errShare
errSave
D-NeRF: Neural Radiance Fields for Dynamic Scenes
err2021-06-01
err0
errOAAI
errAlbert Pumarola; Enric Corona; Gerard Pons-Moll; Francesc Moreno-Noguer
errShare
errSave
NeFF: Neural Feature Fields for Few-Shot View Synthesis Addressing the Shape-Radiance Ambiguity
err2024-01-01
err0
PREAI
errChang, Yuan; Ding, Peng; Shen, Yun; Liang, Wei; Yang, Mingchuan
errShare
errSave
S3IM: Stochastic Structural SIMilarity and Its Unreasonable Effectiveness for Neural Fields
err2023-10-01
err0
errOAAI
errZeke Xie; Xindi Yang; Yujie Yang; Qi Sun; Yixiang Jiang; Haoran Wang; Yunfeng Cai; Mingming Sun
errShare
errSave
researcher View more