arrow
返回

Wavelet-Based Texture Reformation Network for Image Super-Resolution

delete2022-01-01
delete21
PRE
AI
Z
Zhen Li
K
Kuang, Zeng-Sheng
Z
Zhu, Zuo-Liang
王鸿鹏 封面图
王鸿鹏 (Hongpeng Wang) *
S
Shao, Xiu-Li
DOI:10.1109/TIP.2022.3160072delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Most reference-based image super-resolution (RefSR) methods directly leverage the raw features extracted from a pretrained VGG encoder to transfer the matched texture information from a reference image to a low-resolution image. We argue that simply operating on these raw features neglects the influence of irrelevant and redundant information and the importance of abundant high-frequency representations, leading to undesirable texture matching and transfer results. Taking the advantages of wavelet transformation, which represents the contextual and textural information of features at different scales, we propose a Wavelet-based Texture Reformation Network (WTRN) for RefSR. We first decompose the extracted texture features into low-frequency and high-frequency sub-bands and conduct feature matching on the low-frequency component. Based on the correlation map obtained from the feature matching process, we then separately swap and transfer wavelet-domain features at different stages of the network. Furthermore, a wavelet-based texture adversarial loss is proposed to make the network generate more visually plausible textures. Experiments on four benchmark datasets demonstrate that our proposed method outperforms previous RefSR methods both quantitatively and qualitatively. The source code is available at https://github.com/zskuang58/WTRN-TIP.
Keyword:
Wavelet transforms
Feature extraction
Superresolution
Correlation
Image reconstruction
Deep learning
Visualization
Super-resolution
texture transfer
reference-based super-resolution
wavelet decomposition
adversarial loss

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

N
nankai university
学者数:
4.8W
论文数: 3.3W
被引数: 74
引用论文

引用论文

Photoperiod modulates the gut microbiome and aggressive behavior in Siberian hamsters
err2019-01-01
err0
errOAAI
errClarissa C. Ren; Kristyn E. Sylvia; Kathleen M. Munley; Jessica E. Deyoe; Sarah G. Henderson; Michael P. Vu; Gregory E. Demas
err分享
err收藏
Making a Completely Blind Image Quality Analyzer制作全盲图像质量分析仪
err2013-03-01
err4.2K
PREAI
errMittal, Anish; Soundararajan, Rajiv; Bovik, Alan C.
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Nurses’ Attitudes Towards People with Dementia: the semantic differential technique
err2006-05-01
err0
PREAI
errKarl-Gustaf Norbergh; Yvonne Helin; Annika Dahl; Ove Hellzén; Kenneth Asplund
err分享
err收藏
学者 查看更多内容