.png){kind=icon}
返回
Diff-ReColor: Rethinking image colorization with a generative diffusion model
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2024.112133.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper presents Diff-ReColor, a novel diffusion -based image colorization framework that addresses the challenges of colorizing grayscale images with high semantic fidelity and diversity. Recognizing the limitations of previous approaches, including CNN -based methods and GANs, which often resulted in ambiguous colorization and artifacts, we leverage the recent advancements in diffusion models known for their stable training and diverse output generation. Diff-ReColor integrates an edge -conditional Denoising Diffusion Probabilistic Model (DDPM) with Dual -Tier Attention Color Reference Encoder, and a segmentation -informed sampling technique to produce colorized images that are both semantically consistent and rich in detail. Our edgeconditional DDPM is specifically designed to handle intricate image details, while the segmentation -guided sampling technique ensures the retention of semantic nuances by utilizing edge and segmentation cues during the colorization process. Inputs are also channeled into a dual attention encoder, where spectral -attention filters semantic information enhanced by spatial -attention, acquiring coarse coloring images to assist the denoising process. Empirical validation on the ImageNet benchmark dataset demonstrates the superior performance of Diff-ReColor in terms of color richness, colorization accuracy, and semantic fidelity. The model's generalization capabilities are further highlighted through its performance on COCO-Stuff and CelebA-HQ datasets, where it surpasses the baseline models without the need for fine-tuning.
Keyword:
Image colorization
Image restoration
Diffusion model
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
.png){kind=icon}
Performance enhancement of MgZnO ultraviolet photodetectors using ultrathin Al2O3 inserted layer
PREAI
分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Metal-organic chemical vapor deposition of indium selenide films using a single-source precursor使用单源前体对硒化铟薄膜进行金属有机化学气相沉积
PREAI
分享收藏
查看更多内容