arrow
Return

Enhancing light field image super-resolution through Mamba-based spatial–angular correlation learning

delete2025-09-22
delete0
PRE
AI
S
Shaorui Chen
L
Liang Chen *
吴
吴德烽 (Defeng Wu)
Y
Yi Wu
齐娜 cover
齐娜 (Na Qi)
DOI:10.1007/s00371-025-04178-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Light field cameras capture both spatial intensity and directional information of light rays, enabling applications such as depth perception, 3D reconstruction, and view rendering. However, the simultaneous capture of high spatial and angular resolutions remains challenging, densely angular sampling results in sub-aperture images (SAIs) with low spatial resolution. In this paper, we address this issue by proposing a novel approach for LF image SR that leverages Mamba, a state-space model (SSM) equipped with a selective scan mechanism, to effectively capture nonlocal spatial–angular correlation. Our method transforms 4D LF images into 2D epipolar plane images (EPIs) and employs an SSM-based block with a selective scan mechanism to explore the spatial–angular correlation within EPIs. Additionally, we propose a pyramid feature extraction module (PFEM) to extract richer information during the early processing stages. Experimental results on five public benchmark datasets demonstrate that our method not only outperforms state-of-the-art LF image SR approaches but also maintains competitive performance in real-world scenarios, achieving PSNR gains of up to 0.85 dB over the next-best method on the EPFL dataset at $$\times 4$$ upscaling. The source code and datasets used in this study are publicly available at https://github.com/ChenSorry/MambaLFSR .
Keywords:
Super-resolution
Light field
Mamba
Spatial–angular correlation

Journal

T
The Visual Computer
IF:
0
Papers:
369
Citations:
0

Organization

S
School of Marine Engineering
Scholars:
9
Papers: 6
Citations: 0
C
college of photonic and electronic engineering
Scholars:
7
Papers: 7
Citations: 0
C
College of Computer Science
Scholars:
359
Papers: 172
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
Light Field Inpainting Propagation via Low Rank Matrix Completion
err2018-04-01
err100
errOAAI
errLe Pendu, Mikael; Jiang, Xiaoran; Guillemot, Christine
errShare
errSave
TMSDNet: Transformer with multi‐scale dense network for single and multi‐view 3D reconstruction
err2023-08-03
err0
errOAAI
errXiaoqiang Zhu; Xinsheng Yao; Junjie Zhang; Mengyao Zhu; Lihua You; Xiaosong Yang; Jianjun Zhang; He Zhao; Dan Zeng
errShare
errSave
Light Field Image Super-Resolution With Transformers
err2022-01-01
err94
errOAAI
errLiang, Zhengyu; Wang, Yingqian; Wang, Longguang; Yang, Jungang; Zhou, Shilin
errShare
errSave
EAPT: Efficient Attention Pyramid Transformer for Image Processing
err2023-01-01
err199
PREAI
errLin, Xiao; Sun, Shuzhou; Huang, Wei; Sheng, Bin; Li, Ping; Feng, David Dagan
errShare
errSave
Hierarchical feature fusion network for light field spatial super-resolution
err2022-02-03
err2
PREAI
errHua, Xiyao; Wang, Minghui; Su, Boni; Liu, Xia
errShare
errSave
Learning Sheared EPI Structure for Light Field Reconstruction
err2019-07-01
err97
PREAI
errWu, Gaochang; Liu, Yebin; Dai, Qionghai; Chai, Tianyou
errShare
errSave
researcher View more