Light Field Image Super-Resolution With Transformers

Zhengyu Liang

doi:10.1109/LSP.2022.3146798

Light Field Image Super-Resolution With Transformers

2022-01-01

94

OA

AI

DOI：10.1109/LSP.2022.3146798

原文链接

原文求助

摘要

En 中文

Light field (LF) image super-resolution (SR) aims at reconstructing high-resolution LF images from their low-resolution counterparts. Although CNN-based methods have achieved remarkable performance in LF image SR, these methods cannot fully model the non-local properties of the 4D LF data. In this paper, we propose a simple but effective Transformer-based method for LF image SR. In our method, an angular Transformer is designed to incorporate complementary information among different views, and a spatial Transformer is developed to capture both local and long-range dependencies within each sub-aperture image. With the proposed angular and spatial Transformers, the beneficial information in an LF can be fully exploited and the SR performance is boosted. We validate the effectiveness of our angular and spatial Transformers through extensive ablation studies, and compare our method to recent state-of-the-art methods on five public LF datasets. Our method achieves superior SR performance with a small model size and low computational cost. Code is available at.(1)

Keyword:

Transformers

Superresolution

Feature extraction

Spatial resolution

Light fields

Encoding

Convolution

Light field

image super-resolution

transformer

Light Field Image Super-Resolution With Transformers

摘要

期刊

机构