arrow
Return

Automatic Example-Based Image Colorization Using Location-Aware Cross-Scale Matching

delete2019-09-01
delete36
delete
OA
AI
李波 (Bo Li) *
Y
Yu‐Kun Lai
M
Matthew John
P
Paul L. Rosin
DOI:10.1109/TIP.2019.2912291delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Given a reference color image and a destination grayscale image, this paper presents a novel automatic colorization algorithm that transfers color information from the reference image to the destination image. Since the reference and destination images may contain content at different or even varying scales (due to changes of distance between objects and the camera), existing texture matching-based methods can often perform poorly. We propose a novel cross-scale texture matching method to improve the robustness and quality of the colorization results. Suitable matching scales are considered locally, which are then fused using global optimization that minimizes both the matching errors and spatial change of scales. The minimization is efficiently solved using a multi-label graph-cut algorithm. Since only low-level texture features are used, texture matching-based colorization can still produce semantically incorrect results, such as meadow appearing above the sky. We consider a class of semantic violation where the statistics of up-down relationships learned from the reference image are violated and propose an effective method to identify and correct unreasonable colorization. Finally, a novel nonlocal l(1) optimization framework is developed to propagate high confidence micro-scribbles to regions of lower confidence to produce a fully colorized image. Qualitative and quantitative evaluations show that our method outperforms several state-of-the-art methods.
Keywords:
Image colorization
cross-scale texture matching
location statistics
graph cut
sparse
edge preserving
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

C
Cardiff University
Scholars:
2.7W
Papers: 2.5W
Citations: 3.5W
N
Nanchang Hangkong University
Scholars:
7.1K
Papers: 3.9K
Citations: 81