arrow
返回

Example-Based Conditioning for Text-to-Image Generative Models

delete2024-01-01
delete0
delete
OA
AI
A
Atsushi Takada
W
Wataru Kawabe
Y
Yusuke Sugano *
DOI:10.1109/ACCESS.2024.3486055delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Recent progress in image generation has made it possible to create high-quality images. Techniques using diffusion models have shown great potential in producing high-quality images from simple prompts, attracting inexperienced beginners in deep learning. However, prompt-based image generation often produces images that do not match the user's expectations. Merely describing an image might not yield the desired result, and users might struggle to describe what they want accurately. This study introduces a new paradigm of example-based conditioning for interactive image generation to address this useability challenge. Our method presents users with a selection of images, allowing them to define categories by choosing examples that match their objectives. These examples serve as training data for our system to learn to generate prompts conditioned on the categories, thereby creating a variety of images according to the category requirements. Through user experiments, we demonstrate the advantages of our approach compared to the prompt-based baseline.
Keyword:
Text to image
Image synthesis
Birds
Mouth
Diffusion models
Training
Linguistics
Generators
Beak
Writing
Image Generation
diffusion models
interactive machine learning
human-AI interaction
example-based Learning
deep learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
30.9W

机构

U
University of Tokyo
学者数:
1.3K
论文数: 510
被引数: 0
引用论文

引用论文

Advanced pulmonary sarcoidosis
err2014-09-01
err0
errOAAI
errDominique Valeyre; Hilario Nunes; Jean-François Bernaudin
err分享
err收藏
Synthesis: Cooperative breeding in the twenty-first century
err2016-01-07
err0
PREAI
errWalter D. Koenig; Janis L. Dickinson; Stephen T. Emlen
err分享
err收藏
Thin film coating technologies of (Ce,Gd)O2-δ interlayers for application in ceramic high-temperature fuel cells
err2007-02-01
err0
PREAI
errS. Uhlenbruck; N. Jordan; D. Sebold; H.P. Buchkremer; V.A.C. Haanappel; D. Stöver
err分享
err收藏
err分享
err收藏
Vigorous exercise as a triggering mechanism for late stent thrombosis: A description of three cases
err2009-11-23
err0
PREAI
errBastiaan Zwart; Tjitske C. Van Kerkvoorde; Jochem W. Van Werkum; Nicoline J. Breet; Jurriën M. Ten Berg; Arnoud W. J. Van ‘T Hof
err分享
err收藏
学者 查看更多内容