返回
An Interactive Image Editing System Using an Uncertainty-Based Confirmation Strategy
DOI:10.1109/ACCESS.2020.2997012.png)
摘要
En 中文
We propose an interactive image editing system that has a confirmation dialogue strategy using an entropy-based uncertainty calculation on its generated images with Deep Convolutional Generative Adversarial Networks (DCGAN). DCGAN is an image generative model that learns an image manifold of a given dataset and enables continuous change of an image. Our proposed image editing system combines DCGAN with a natural language interface that accepts image editing requests in natural language. Although such a system is helpful for human users, it often faces uncertain requests to generate acceptable images. A promising approach to solve this problem is introducing a dialogue process that shows multiple candidates and confirms the user's intention. However, confirming every editing request creates redundant dialogues. To achieve more efficient dialogues, we propose an entropy-based dialogue strategy that decides when the system should confirm, and enables effective image editing through a dialogue that reduces redundant confirmations. We conducted image editing dialogue experiments using an avatar face illustration dataset for editing by natural language requests. Through quantitative and qualitative analysis, our results show that our entropy-based confirmation strategy achieved an effective dialogue by generating images desired by users.
Keyword:
Natural languages
Generators
Generative adversarial networks
Task analysis
Training
Hair
Image generation
Confirmation
generative adversarial networks
image editing
natural language interface
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Mechanisms and Dynamics of Layered Structure Formation During Co-Deposition of Binary Compound Thin Films
Coatings
IF0
The Effect of Electron Irradiation on the Structure of Sodium Aluminum-Iron Phosphate Glasses电子辐照对磷酸铝铁钠玻璃结构的影响
MRS Advances
IF0
What can crop stable isotopes ever do for us? An experimental perspective on using cereal carbon stable isotope values for reconstructing water availability in semi-arid and arid environments作物稳定同位素究竟能为我们做什么?从实验角度看,利用谷物碳稳定同位素值重建半干旱和干旱环境中的水分可用性
Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用
PROCEEDINGS OF THE IEEE
IF25.9

