arrow
返回

Frequency-Based Enhancement Network for Efficient Super-Resolution

delete2022-01-01
delete6
delete
OA
AI
P
Parichehr Behjati *
P
Pau Rodríguez
C
Carles Fernandez Tena
A
Armin Mehri
F
F. Xavier Roca
S
Seiichi Ozawa
J
Jordi Gonzàlez
DOI:10.1109/ACCESS.2022.3176441delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, deep convolutional neural networks (CNNs) have provided outstanding performance in single image super-resolution (SISR). Despite their remarkable performance, the lack of high-frequency information in the recovered images remains a core problem. Moreover, as the networks increase in depth and width, deep CNN-based SR methods are faced with the challenge of computational complexity in practice. A promising and under-explored solution is to adapt the amount of compute based on the different frequency bands of the input. To this end, we present a novel Frequency-based Enhancement Block (FEB) which explicitly enhances the information of high frequencies while forwarding low-frequencies to the output. In particular, this block efficiently decomposes features into low- and high-frequency and assigns more computation to high-frequency ones. Thus, it can help the network generate more discriminative representations by explicitly recovering finer details. Our FEB design is simple and generic and can be used as a direct replacement of commonly used SR blocks with no need to change network architectures. We experimentally show that when replacing SR blocks with FEB we consistently improve the reconstruction error, while reducing the number of parameters in the model. Moreover, we propose a lightweight SR model - Frequency-based Enhancement Network (FENet) - based on FEB that matches the performance of larger models. Extensive experiments demonstrate that our proposal performs favorably against the state-of-the-art SR algorithms in terms of visual quality, memory footprint, and inference time. The code is available at https://github.com/pbehjatii/FENet
Keyword:
Computer architecture
Superresolution
Computational modeling
Visualization
Network architecture
Computational efficiency
Buildings
Deep learning
frequency-based methods
lightweight architectures
single image super-resolution

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

K
kobe university
学者数:
1.6W
论文数: 1.2W
被引数: 8
C
centre de visio per computador (cvc)
学者数:
291
论文数: 246
被引数: 0
A
Autonomous University of Barcelona
学者数:
3.7W
论文数: 2.6W
被引数: 47
学者 查看更多机构
引用论文

引用论文

Computational characterization of a-Si:H/c-Si interfaces
err2018-08-30
err0
PREAI
errPhilippe Czaja; Simone Giusepponi; Michele Gusso; Massimo Celino; Urs Aeberhard
err分享
err收藏
Testing the low latitude/high defense hypothesis for broad-leaved tree species
err2012-01-22
err0
PREAI
errRobert J. Marquis; Robert E. Ricklefs; Luis Abdala-Roberts
err分享
err收藏
Hierarchical dense recursive network for image super-resolution
err2020-11-01
err184
PREAI
errJiang, Kui; Wang, Zhongyuan; Yi, Peng; Jiang, Junjun
err分享
err收藏
学者 查看更多内容