arrow
返回

A Practical Contrastive Learning Framework for Single-Image Super-Resolution

delete2024-11-01
delete15
delete
OA
AI
吴刚 封面图
吴刚 (Gang Wu)
J
Junjun Jiang *
刘
刘贤明 (Xianming Liu)
DOI:10.1109/TNNLS.2023.3290038delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Contrastive learning has achieved remarkable success on various high-level tasks, but there are fewer contrastive learning-based methods proposed for low-level tasks. It is challenging to adopt vanilla contrastive learning technologies proposed for high-level visual tasks to low-level image restoration problems straightly. Because the acquired high-level global visual representations are insufficient for low-level tasks requiring rich texture and context information. In this article, we investigate the contrastive learning-based single-image super-resolution (SISR) from two perspectives: positive and negative sample construction and feature embedding. The existing methods take naive sample construction approaches (e.g., considering the low-quality input as a negative sample and the ground truth as a positive sample) and adopt a prior model (e.g., pretrained very deep convolutional networks proposed by visual geometry group (VGG) model) to obtain the feature embedding. To this end, we propose a practical contrastive learning framework for SISR (PCL-SR). We involve the generation of many informative positive and hard negative samples in frequency space. Instead of utilizing an additional pretrained network, we design a simple but effective embedding network inherited from the discriminator network, which is more task-friendly. Compared with the existing benchmark methods, we retrain them by our proposed PCL-SR framework and achieve superior performance. Extensive experiments have been conducted to show the effectiveness and technical contributions of our proposed PCL-SR thorough ablation studies. The code and resulting models will be released via https://github.com/Aitical/PCL-SISR.
Keyword:
Contrastive learning
data augmentation
feature embedding
super-resolution

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
引用论文

引用论文

Waveguiding in supported phononic crystal plates
err2007-12-20
err0
errOAAI
errJ Vasseur; A-C Hladky-Hennion; P Deymier; B Djafari-Rouhani; F Duval; B Dubus; Y Pennec
err分享
err收藏
Wavelet-Based Dual Recursive Network for Image Super-Resolution
err2022-02-01
err49
PREAI
errXin, Jingwei; Li, Jie; Jiang, Xinrui; Wang, Nannan; Huang, Heng; Gao, Xinbo
err分享
err收藏
Novel de novo variant in EBF3 is likely to impact DNA binding in a patient with a neurodevelopmental disorder and expanded phenotypes: patient report, in silico functional assessment, and review of published cases
err2017-03-10
err0
errOAAI
errPatrick R. Blackburn; Sarah S. Barnett; Michael T. Zimmermann; Margot A. Cousin; Charu Kaiwar; Filippo Pinto e Vairo; Zhiyv Niu; Matthew J. Ferber; Raul A. Urrutia; Duygu Selcen; Eric W. Klee; Pavel N. Pichurin
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容