arrow
Return

An Interactive Image Editing System Using an Uncertainty-Based Confirmation Strategy

delete2020-01-01
delete1
delete
OA
AI
S
Seitaro Shinagawa *
K
Koichiro Yoshino
S
Seyed Hossein Alavi
K
Kallirroi Georgila
D
David Traum
S
Sakriani Sakti
S
Satoshi Nakamura
DOI:10.1109/ACCESS.2020.2997012delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We propose an interactive image editing system that has a confirmation dialogue strategy using an entropy-based uncertainty calculation on its generated images with Deep Convolutional Generative Adversarial Networks (DCGAN). DCGAN is an image generative model that learns an image manifold of a given dataset and enables continuous change of an image. Our proposed image editing system combines DCGAN with a natural language interface that accepts image editing requests in natural language. Although such a system is helpful for human users, it often faces uncertain requests to generate acceptable images. A promising approach to solve this problem is introducing a dialogue process that shows multiple candidates and confirms the user's intention. However, confirming every editing request creates redundant dialogues. To achieve more efficient dialogues, we propose an entropy-based dialogue strategy that decides when the system should confirm, and enables effective image editing through a dialogue that reduces redundant confirmations. We conducted image editing dialogue experiments using an avatar face illustration dataset for editing by natural language requests. Through quantitative and qualitative analysis, our results show that our entropy-based confirmation strategy achieved an effective dialogue by generating images desired by users.
Keywords:
Natural languages
Generators
Generative adversarial networks
Task analysis
Training
Hair
Image generation
Confirmation
generative adversarial networks
image editing
natural language interface
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
university of southern california
Scholars:
4.6W
Papers: 3.8W
Citations: 51
N
nara institute of science & technology
Scholars:
4.1K
Papers: 3.1K
Citations: 7