arrow
返回

Transparent Image Layer Diffusion using Latent Transparency

delete2024-07-19
delete0
delete
OA
AI
L
Lvmin Zhang *
M
Maneesh Agrawala
DOI:10.1145/3658150delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
我们提出了一种使大规模预训练的潜在扩散模型能够生成透明图像的方法。该方法允许生成单个透明图像或多个透明层。该方法学习将alpha通道透明度编码到预训练的潜在扩散模型的潜在流形中的潜在透明度。它通过调节增加的透明度作为潜在偏移,保留了大型扩散模型的生产就绪质量,而对预训练模型的原始潜在分布的变化最小。以这种方式,通过用调整的潜在空间对任何潜在扩散模型进行微调,可以将其转换为透明图像生成器。我们使用使用人类在环收集方案收集的1m个透明图像层对来训练模型。我们证明了潜在的透明度可以应用于不同的开源图像生成器,也可以应用于各种条件控制系统,以实现诸如前景/背景条件层生成,联合层生成,层内容的结构控制等应用。一项用户研究发现,在大多数情况下 (97%),用户更喜欢我们本地生成的透明内容,而不是以前的临时解决方案,例如生成然后进行消光。用户还报告说,我们生成的透明图像的质量可与Adobe Stock等真正的商业透明资产相媲美。
Keyword:
Transparent images
image editing
image layer
text-to-image diffusion

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

S
Stanford University
学者数:
9.6W
论文数: 8.2W
被引数: 17.0W
引用论文

引用论文

Europa’s Crater Distributions and Surface Ages
err2024-08-19
err0
PREAI
errEdward B. Bierhaus; Kevin Zahnle; Clark R. Chapman
err分享
err收藏
Application of the ARCAS group-hybrid decision-making method for wastewater reuse
err2022-12-08
err0
PREAI
errKosar Ebrahimzadeh Azbari; Parisa-Sadat Ashofteh; Parvin Golfam; Hugo A. Loáiciga
err分享
err收藏
Decomposing Time-Lapse Paintings into Layers
err2015-07-27
err23
PREAI
errTan, Jianchao; Dvoroznak, Marek; Sykora, Daniel; Gingold, Yotam
err分享
err收藏
Simulation of the influence of a fine-scale urban underlying surface on the urban heat island effect in Beijing
err2021-11-01
err0
PREAI
errTian Liang; Jianjun He; Liang Chen; Zhangyu Yao; Lei Zhang; Huizheng Che; Sunling Gong
err分享
err收藏
Mapping novel aphid resistance QTL from wild soybean, Glycine soja 85-32
err2017-07-14
err0
PREAI
errShichen Zhang; Zhongnan Zhang; Carmille Bales; Cuihua Gu; Chris DiFonzo; Ming Li; Qijian Song; Perry Cregan; Zhenyu Yang; Dechun Wang
err分享
err收藏
Detection of Renal Tissue and Urinary Tract Proteins in the Human Urine after Space Flight
err2013-08-13
err0
errOAAI
errLyudmila Kh. Pastushkova; Kirill S. Kireev; Alexey S. Kononikhin; Evgeny S. Tiys; Igor A. Popov; Natalia L. Starodubtseva; Igor V. Dobrokhotov; Vladimir A. Ivanisenko; Irina M. Larina; Nicolay A. Kolchanov; Evgeny N. Nikolaev
err分享
err收藏
Acute toxicity and bioaccumulation of pesticide Diazinon in red tilapia (Oreochromis niloticus x Mossambicus albina)
err2002-07-25
err0
PREAI
errJaime A. Palacio; Beatriz Henao; Jorge H. Vélez; Jairo González; Carlos M. Parra
err分享
err收藏
Quantification of Land Use Diversity in The Context of Mixed Land Use
err2013-12-01
err0
errOAAI
errRupjyoti Bordoloi; Amit Mote; Partha Pratim Sarkar; C. Mallikarjuna
err分享
err收藏
学者 查看更多内容