arrow
Return

Image Hallucination From Attribute Pairs

delete2022-01-01
delete8
PRE
AI
F
Fuxiang Wu
J
Jun Cheng *
X
Xinchao Wang
L
Lei Wang
陶大鹏 cover
陶大鹏 (Dapeng Tao)
DOI:10.1109/TCYB.2020.2979258delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent image-generation methods have demonstrated that realistic images can be produced from captions. Despite the promising results achieved, existing caption-based generation methods confront a dilemma. On the one hand, the image generator should be provided with sufficient details for realistic hallucination, meaning that longer sentences with rich content are preferred, but on the other hand, the generator is meanwhile fragile to long sentences due to their complex semantics and syntax like long-range dependencies and the combinatorial explosion of object visual features. Toward alleviating this dilemma, a novel approach is proposed in this article to hallucinate images from attribute pairs, which can be extracted from natural language processing (NLP) toolsets in the presence of complex semantics and syntax. Attribute pairs, therefore, enable our image generator to tackle long sentences handily and alleviate the combinatorial explosion, and at the same time, allow us to enlarge the training dataset and to produce hallucinations from randomly combined attribute pairs at ease. Experiments on widely used datasets demonstrate that the proposed approach yields results superior to the state of the art.
Keywords:
Gallium nitride
Semantics
Visualization
Generators
Syntactics
Training
Natural language processing
Attentional generative adversarial network (GAN)
attribute pair
text-to-image synthesis
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

C
Chinese University of Hong Kong
Scholars:
3.4W
Papers: 3.2W
Citations: 5.6W
S
Stevens Institute of Technology
Scholars:
2.9K
Papers: 2.9K
Citations: 3.2K
C
chinese academy of sciences
Scholars:
56.4W
Papers: 44.9W
Citations: 704
researcher View more organizations