arrow
返回

Image Quality Assessment Using Contrastive Learning

delete2022-01-01
delete90
delete
OA
AI
P
Pavan C. Madhusudana *
N
Neil Birkbeck
Y
Yilin Wang
B
Balu Adsumilli
A
Alan C. Bovik
DOI:10.1109/TIP.2022.3181496delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We consider the problem of obtaining image quality representations in a self-supervised manner. We use prediction of distortion type and degree as an auxiliary task to learn features from an unlabeled image dataset containing a mixture of synthetic and realistic distortions. We then train a deep Convolutional Neural Network (CNN) using a contrastive pairwise objective to solve the auxiliary problem. We refer to the proposed training framework and resulting deep IQA model as the CONTRastive Image QUality Evaluator (CONTRIQUE). During evaluation, the CNN weights are frozen and a linear regressor maps the learned representations to quality scores in a No-Reference (NR) setting. We show through extensive experiments that CONTRIQUE achieves competitive performance when compared to state-of-the-art NR image quality models, even without any additional fine-tuning of the CNN backbone. The learned representations are highly robust and generalize well across images afflicted by either synthetic or authentic distortions. Our results suggest that powerful quality representations with perceptual relevance can be obtained without requiring large labeled subjective image quality datasets. The implementations used in this paper are available at https://github.com/pavancm/CONTRIQUE.
Keyword:
Distortion
Task analysis
Image quality
Predictive models
Training
Convolutional neural networks
Computational modeling
No reference image quality assessment
blind image quality assessment
self-supervised learning
deep learning

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
university of texas austin
学者数:
2.4W
论文数: 2.0W
被引数: 54
U
university of texas system
学者数:
18.5W
论文数: 15.6W
被引数: 210
引用论文

引用论文

Making a Completely Blind Image Quality Analyzer制作全盲图像质量分析仪
err2013-03-01
err4.2K
PREAI
errMittal, Anish; Soundararajan, Rajiv; Bovik, Alan C.
err分享
err收藏
Dynamic Receptive Field Generation for Full-Reference Image Quality Assessment
err2020-01-01
err41
PREAI
errKim, Woojae; Nguyen, Anh-Duc; Lee, Sanghoon; Bovik, Alan Conrad
err分享
err收藏
err分享
err收藏
Non-invasive prenatal testing for Down syndrome
err2014-02-01
err0
PREAI
errPhilip Twiss; Melissa Hill; Rebecca Daley; Lyn S. Chitty
err分享
err收藏
Novel de novo variant in EBF3 is likely to impact DNA binding in a patient with a neurodevelopmental disorder and expanded phenotypes: patient report, in silico functional assessment, and review of published cases
err2017-03-10
err0
errOAAI
errPatrick R. Blackburn; Sarah S. Barnett; Michael T. Zimmermann; Margot A. Cousin; Charu Kaiwar; Filippo Pinto e Vairo; Zhiyv Niu; Matthew J. Ferber; Raul A. Urrutia; Duygu Selcen; Eric W. Klee; Pavel N. Pichurin
err分享
err收藏
Meeting the demand: geothermal heat supply rates for an urban quarter in Germany
err2019-03-23
err0
errOAAI
errCarolin Tissen; Kathrin Menberg; Peter Bayer; Philipp Blum
err分享
err收藏
学者 查看更多内容