.png){kind=icon}
返回
Spatial-angular-epipolar transformer for light field spatial and angular super-resolution
.png){kind=icon}
PRE
AI
DOI：10.1016/j.displa.2024.102816.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Transformer-based light field (LF) super-resolution (SR) methods have recently achieved significant performance improvements due to global feature modeling by self-attention mechanisms. However, as a method designed for natural language processing, 4D LFs are reshaped into 1D sequences with an immense set of tokens, which results in a quadratic computational complexity cost. In this paper, a spatial-angular-epipolar swin transformer (SAEST) is proposed for spatial and angular SR (SASR), which sufficiently extracts SR information in the spatial, angular, and epipolar domains using local self-attention with shifted windows. Specifically, in SAEST, a spatial swin transformer and an angular standard transformer are firstly cascaded to extract spatial and angular SR features, separately. Then, the extracted SR feature is reshaped into the epipolar plane image pattern and fed into an epipolar swin transformer to extract the spatial-angular correlation information. Finally, several SAEST blocks are cascaded in a Unet framework to extract multi-scale SR features for SASR. Experiment results indicate that SAEST is a fast transformer-based SASR method with less running time and GPU consumption and has outstanding performance on simulated and real-world public datasets.
Keyword:
Light field spatial and angular super-resolution
Fast transformer-based algorithm
Unet swin transformer
Spatial-angular correlation
Spatial-angular-epipolar features
期刊
IF:
3.4
论文数:
2.3K
被引数:
3.2K
机构
引用论文
Learning an epipolar shift compensation for light field image super-resolution.png)
INFORMATION FUSION
INFORMATION FUSIONIF15.5
PREAI
分享收藏Red, green, and blue electrochromism in ambipolar poly(amine–amide–imide)s based on electroactive tetraphenyl‐p‐phenylenediamine units基于电活性四苯基 p-苯二胺单元的双极性聚 (胺-酰胺-酰亚胺) 中的红色，绿色和蓝色电致变色
PREAI
分享收藏
查看更多内容