arrow
Return

PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing

delete2009-07-27
delete2.4K
PRE
AI
C
Connelly Barnes *
E
Eli Shechtman
A
Adam Finkelstein
D
Dan B Goldman
DOI:10.1145/1531326.1531330delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper presents interactive image editing tools using a new randomized algorithm for quickly finding approximate nearest-neighbor matches between image patches. Previous research in graphics and vision has leveraged such nearest-neighbor searches to provide a variety of high-level digital image editing tools. However, the cost of computing a field of such matches for an entire image has eluded previous efforts to provide interactive performance. Our algorithm offers substantial performance improvements over the previous state of the art (20-100x), enabling its use in interactive editing tools. The key insights driving the algorithm are that some good patch matches can be found via random sampling, and that natural coherence in the imagery allows us to propagate such matches quickly to surrounding areas. We offer theoretical analysis of the convergence properties of the algorithm, as well as empirical and practical evidence for its high quality and performance. This one simple algorithm forms the basis for a variety of tools-image retargeting, completion and reshuffling-that can be used together in the context of a high-level image editing application. Finally, we propose additional intuitive constraints on the synthesis process that offer the user a level of control unavailable in previous methods.
Keywords:
Approximate nearest neighbor
patch-based synthesis
image editing
completion
retargeting
reshuffling

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.9K
Citations:
4.4W

Organization

P
princeton university
Scholars:
3.0K
Papers: 1.2K
Citations: 2.8W
A
adobe systems inc.
Scholars:
0
Papers: 6
Citations: 327
Cited Papers

Cited Papers

Exploring complex CIDEP ofp-benzosemiquinones with time resolved CW-EPR
err2002-05-10
err0
PREAI
errMARTIN JÄGER; BRIAN C. YU; JAMES R. NORRIS
errShare
errSave
Serum factor in Miller-Fisher variant of Guillain-Barré syndrome and neurotransmitter release
err1994-02-01
err0
PREAI
errM. Roberts; A. Vincent; J. Newsom-Davis; H. Willison
errShare
errSave
Improved seam carving for video retargeting
err2008-08-01
err602
PREAI
errRubinstein, Michael; Shamir, Ariel; Avidan, Shai
errShare
errSave
errShare
errSave
Real-time texture synthesis by patch-based sampling
err2001-07-01
err488
PREAI
errLiang, L; Liu, C; Xu, YQ; Guo, BN; Shum, HY
errShare
errSave
13C Chemical Shift Tensors in Hypoxanthine and 6-Mercaptopurine: Effects of Substitution, Tautomerism, and Intermolecular Interactions
err2010-01-07
err0
PREAI
errKateřina Maliňáková; Lucie Novosadová; Manu Lahtinen; Erkki Kolehmainen; Jiří Brus; Radek Marek
errShare
errSave
Optimization Model for the Supply Volume of Bike-Sharing: Case Study in Nanjing, China
err2021-04-23
err0
errOAAI
errJiajie Yu; Yanjie Ji; Chenyu Yi; Chenchen Kuai; Dmitry Ivanovich Samal
errShare
errSave
researcher View more