arrow
返回

RealFill: Reference-Driven Generation for Authentic Image Completion

delete2024-07-19
delete0
delete
OA
AI
L
Luming Tang *
N
Nataniel Ruiz
Q
Qinghao Chu
Y
Yuanzhen Li
A
Aleksander Holynski
D
David Jacobs
B
Bharath Hariharan
Y
Yael Pritch
N
Neal Wadhwa
K
Kfir Aberman
M
Michael Rubinstein
DOI:10.1145/3658237delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent advances in generative imagery have brought forth outpainting and inpainting models that can produce high-quality, plausible image content in unknown regions. However, the content these models hallucinate is necessarily inauthentic, since they are unaware of the true scene. In this work, we propose RealFill, a novel generative approach for image completion that fills in missing regions of an image with the content that should have been there. RealFill is a generative inpainting model that is personalized using only a few reference images of a scene. These reference images do not have to be aligned with the target image, and can be taken with drastically varying viewpoints, lighting conditions, camera apertures, or image styles. Once personalized, RealFill is able to complete a target image with visually compelling contents that are faithful to the original scene. We evaluate RealFill on a new image completion benchmark that covers a set of diverse and challenging scenarios, and find that it outperforms existing approaches by a large margin. Project page: https://realfill.github.io.
Keyword:
Image Completion
Diffusion Model

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

C
Cornell University
学者数:
6.3W
论文数: 5.4W
被引数: 10.9W
G
Google Incorporated
学者数:
3.5K
论文数: 1.8K
被引数: 8
引用论文

引用论文

Embedded Generation
err
IF0
err2000-01-01
err0
PREAI
errN. Jenkins; et al.
err分享
err收藏
Alzheimer's disease: mimics and chameleons
err2012-11-08
err0
PREAI
errJonathan M Schott; Jason D Warren
err分享
err收藏
Intra-Abdominal Splenosis Mimicking Metastatic Cancer
err2011-03-01
err0
PREAI
errNicholas J. Short; Teresa G. Hayes; Peeyush Bhargava
err分享
err收藏
err分享
err收藏
Abnormal Cortical Development after Premature Birth Shown by Altered Allometric Scaling of Brain Growth
err2006-08-01
err0
errOAAI
errOlga Kapellou; Serena J Counsell; Nigel Kennea; Leigh Dyet; Nadeem Saeed; Jaroslav Stark; Elia Maalouf; Philip Duggan; Morenike Ajayi-Obe; Jo Hajnal; Joanna M Allsop; James Boardman; Mary A Rutherford; Frances Cowan; A. David Edwards
err分享
err收藏
Pion therapy at TRIUMF. Treatment results for astrocytoma grades 3 and 4: a pilot study
err1990-01-01
err0
PREAI
errG.B. Goodman; L.D. Skarsgard; G.B. Thompson; R. Harrison; G.K.Y. Lam; C. Lugate
err分享
err收藏
err分享
err收藏
err1998-01-01
err0
PREAI
errMin-Ling Chung; Fang-Yuan Lee; Li-Chun Lin; Chi-Jung Su; Min-Yen Chen; Yuh-Sheng Wen; Han-Mou Gau; Kuang-Lieh Lu
err分享
err收藏
学者 查看更多内容