arrow
返回

Joint intensity-gradient guided generative modeling for colorization

delete2022-12-17
delete1
PRE
AI
K
Kuan Xiong
K
Kai Hong
J
Jin Li
W
Wanyun Li
L
Liao Wei-dong
Q
Qiegen Liu *
DOI:10.1007/s00371-022-02747-0delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
This paper proposes an iterative score-based generative model for solving the automatic colorization problem. Although unsupervised learning methods have shown the capability to generate plausible color, inadequate exploration of detailed information and data dimensions still limit the performance of the colorization model. Considering that the number of samples in score-based generative model has influence on estimating the target gradients and the gradient map possesses important latent information of the image, the inference process of the generative modeling is conducted in joint intensity-gradient domain for colorization. Specifically, a set of intensity-gradient formed high-dimensional tensors are trained, via the score matching, to attain the gradient of data distribution in joint intensity-gradient domain. As the score function is determined, data samples are generated by means of annealed Langevin dynamics, forming an iterative colorization procedure. Furthermore, the joint intensity-gradient constraint in data-fidelity term is proposed to limit the degree of freedom within generative model at the iterative colorization stage, thus being conducive to edge-preserving colorization effect. Experimental results conveyed the remarkable performance and diversity of our proposed method.
Keyword:
Automatic colorization
Unsupervised learning
Generative model
Intensity-gradient domain
Gradient constraint

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.7K
被引数:
6.5K

机构

N
Nanchang University
学者数:
3.7W
论文数: 2.1W
被引数: 3.7W
引用论文

引用论文

The Impact of the Application of Lean Tools for Improvement of Process in a Plastic Company: a case study
err2019-01-01
err0
errOAAI
errP. Ribeiro; J.C. Sá; L.P. Ferreira; F.J.G. Silva; M.T. Pereira; G. Santos
err分享
err收藏
Highly undersampled magnetic resonance imaging reconstruction using autoencoding priors
err2019-08-20
err50
errOAAI
errLiu, Qiegen; Yang, Qingxin; Cheng, Huitao; Wang, Shanshan; Zhang, Minghui; Liang, Dong
err分享
err收藏
Class diversification, economic growth and urban sprawl: evidences from a pre-crisis European city
err2017-07-20
err0
PREAI
errCesare Di Feliciantonio; Luca Salvati; Efthymia Sarantakou; Kostas Rontos
err分享
err收藏
Remote Ischemic Preconditioning Provides Early and Late Protection Against Endothelial Ischemia-Reperfusion Injury in Humans
err2005-08-01
err0
PREAI
errStavros P. Loukogeorgakis; Anna T. Panagiotidou; Michael W. Broadhead; Ann Donald; John E. Deanfield; Raymond J. MacAllister
err分享
err收藏
Gait perturbation response in chronic anterior cruciate ligament deficiency and repair
err2003-02-01
err0
PREAI
errReed Ferber; Louis R Osternig; Marjorie H Woollacott; Noah J Wasielewski; Ji-Hang Lee
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Sa1723 - Comparative Effectiveness of Vedolizumab and Tumor Necrosis Factor-Antagonist Therapy in Crohn's Disease: A Multicenter Consortium Propensity Score-Matched Analysis
err2018-05-01
err0
PREAI
errMatthew Bohm; Sashivar Sagi; Monika Fischer; Siri Kadire; Gloria Tran; Mahmoud Rahal; Satimai Aniwan; Joseph Meserve; Aaron Weiss; Gursimran Kochhar; Preeti Shashi; David Faleck; Adam Winters; Shreya Chablaney; Jenna L. Koliani-Pace; Brigid S. Boland; Siddharth Singh; Robert Hirten; Eugenia Shmidt; Karen Lasch; Michelle Luo; David Hudesman; Shannon Chang; Dana J. Lukin; Sultan Keith; Arun Swaminath; Nitin Gupta; Corey A. Siegel; Sunanda V. Kane; Edward V. Loftus; Bruce E. Sands; William J. Sandborn; Jean Frederic Colombel; Bo Shen; Parambir Dulai
err分享
err收藏
学者 查看更多内容