arrow
Return

Iterative Network for Image Super-Resolution

delete2022-01-01
delete19
delete
OA
AI
刘雨青 (Yuqing Liu)
S
Shiqi Wang
张建 (Jian Zhang)
王苫社 cover
王苫社 (Shanshe Wang)
马思伟 (Siwei Ma) *
W
Wen Gao
DOI:10.1109/TMM.2021.3078615delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Single image super-resolution (SISR), as a traditional ill-conditioned inverse problem, has been greatly revitalized by the recent development of convolutional neural networks (CNN). These CNN-based methods generally map a low-resolution image to its corresponding high-resolution version with sophisticated network structures and loss functions, showing impressive performances. This paper provides a new insight on conventional SISR algorithm, and proposes a substantially different approach relying on the iterative optimization. A novel iterative super-resolution network (ISRN) is proposed on top of the iterative optimization. We first analyze the observation model of image SR problem, inspiring a feasible solution by mimicking and fusing each iteration in a more general and efficient manner. Considering the drawbacks of batch normalization, we propose a feature normalization (F-Norm, FN) method to regulate the features in network. Furthermore, a novel block with FN is developed to improve the network representation, termed as FNB. Residual-in-residual structure is proposed to form a very deep network, which groups FNBs with a long skip connection for better information delivery and stabling the training phase. Extensive experimental results on testing benchmarks with bicubic (BI) degradation show our ISRN can not only recover more structural information, but also achieve competitive or better PSNR/SSIM results with much fewer parameters compared to other works. Besides BI, we simulate the real-world degradation with blur-downscale (BD) and downscale-noise (DN). ISRN and its extension ISRN+ both achieve better performance than others with BD and DN degradation models.
Keywords:
Degradation
Superresolution
Optimization
Image restoration
Visualization
Convolution
Training
Single image super-resolution
iterative optimization
feature normalization

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146
D
Dalian University of Technology
Scholars:
5.9W
Papers: 4.3W
Citations: 5.5W
researcher View more organizations