arrow
Return

Self-supervised cycle-consistent learning for scale-arbitrary real-world single image super-resolution

delete2023-02-01
delete14
delete
OA
AI
陈洪刚 (Honggang Chen)
X
Xiaohai He
H
Hong Yang
Y
Yuanyuan Wu
卿粼波 cover
卿粼波 (Linbo Qing) *
R
Ray E. Sheriff
DOI:10.1016/j.eswa.2022.118657delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Whether conventional machine learning-based or current deep neural networks-based single image super -resolution (SISR) methods, they are generally trained and validated on synthetic datasets, in which low -resolution (LR) inputs are artificially produced by degrading high-resolution (HR) images based on a hand-crafted degradation model (e.g. , bicubic downsampling). One of the main reasons for this is that it is challenging to build a realistic dataset composed of real-world LR-HR image pairs. However, a domain gap exists between synthetic and real-world data because the degradations in real scenarios are more complicated, limiting the performance in practical applications of SISR models trained with synthetic data. To address these problems, we propose a Self-supervised Cycle-consistent Learning-based Scale-Arbitrary Super-Resolution framework (SCL-SASR) for real-world images. Inspired by the Maximum a Posteriori estimation, our SCL-SASR consists of a Scale-Arbitrary Super-Resolution Network (SASRN) and an inverse Scale-Arbitrary Resolution -Degradation Network (SARDN). SARDN and SASRN restrain each other with the bidirectional cycle consistency constraints as well as image priors, making SASRN adapt to the image-specific degradation well. Meanwhile, considering the lack of targeted training images and the complexity of realistic degradations, SCL-SASR is designed to be online optimized solely with the LR input prior to the SR reconstruction. Benefitting from the flexible architecture and the self-supervised learning manner, SCL-SASR can easily super-resolve new images with arbitrary integer or non-integer scaling factors. Experiments on real-world images demonstrate the high flexibility and good applicability of SCL-SASR, which achieves better reconstruction performance than state-of-the-art self-supervised learning-based SISR methods as well as several external dataset-trained SISR models.
Keywords:
Real-world image
Super-resolution
Resolution-degradation
Self-supervised cycle-consistent learning
Arbitrary scaling factors
Convolutional neural networks
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

E
Edge Hill University
Scholars:
1.2K
Papers: 1.3K
Citations: 958
S
sichuan university
Scholars:
11.9W
Papers: 7.7W
Citations: 100
C
Chengdu University of Technology
Scholars:
1.2W
Papers: 6.9K
Citations: 24
researcher View more organizations