返回
Example-Based Conditioning for Text-to-Image Generative Models
DOI:10.1109/ACCESS.2024.3486055.png)
摘要
En 中文
Recent progress in image generation has made it possible to create high-quality images. Techniques using diffusion models have shown great potential in producing high-quality images from simple prompts, attracting inexperienced beginners in deep learning. However, prompt-based image generation often produces images that do not match the user's expectations. Merely describing an image might not yield the desired result, and users might struggle to describe what they want accurately. This study introduces a new paradigm of example-based conditioning for interactive image generation to address this useability challenge. Our method presents users with a selection of images, allowing them to define categories by choosing examples that match their objectives. These examples serve as training data for our system to learn to generate prompts conditioned on the categories, thereby creating a variety of images according to the category requirements. Through user experiments, we demonstrate the advantages of our approach compared to the prompt-based baseline.
Keyword:
Text to image
Image synthesis
Birds
Mouth
Diffusion models
Training
Linguistics
Generators
Beak
Writing
Image Generation
diffusion models
interactive machine learning
human-AI interaction
example-based Learning
deep learning
期刊
IF:
3.6
论文数:
9.8W
被引数:
30.9W
机构
引用论文
Sensorless Control of Z Source Inverter fed BLDC Motor Drive by FOC - DTC Hybrid Control Strategy Using Fuzzy Logic Controller采用模糊逻辑控制器的foc-dtc混合控制策略的Z源逆变器馈电BLDC电机驱动的无传感器控制
Surgical therapy and next-generation sequencing-based genetic alteration analysis of malignant solitary fibrous tumor of the pleura胸膜恶性孤立性纤维瘤的外科治疗和基于二代测序的遗传学改变分析
The Effect of 40-Hz Light Therapy on Amyloid Load in Patients with Prodromal and Clinical Alzheimer’s Disease40Hz光疗法对前驱和临床阿尔茨海默病患者淀粉样蛋白负荷的影响
Relaxation dynamics in single polymer microcapsules probed with laser-generated GHz acoustic waves
Soft Matter
IF0

