arrow
返回

Optimized GAN for Text-to-Image Synthesis: Hybrid Whale Optimization Algorithm and Dragonfly Algorithm

delete2022-11-01
delete9
PRE
AI
V
Vamsidhar Talasila *
M
M. R. Narasingarao
M
Murali Mohan
DOI:10.1016/j.advengsoft.2022.103222delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Text to image synthesizes is a motivating and valuable task to explore in these days. The objective is to produce images from texts or captions, i.e. considering textual descriptions as input and deploying them to produce related images. For carrying this task, two challenging elements of image generation and language modeling should be combined that are said to be more complex than caption generation. This research aims to develop a new text-to-image synthesis method that includes the two crucial steps of (i) text to picture encoding and (ii) optimized GAN. At first, cross-modal feature grouping is done throughout the text to image encoding. Consequently, text embeddings are transformed into textual feature vectors using BI-LSTM. The images are created based on the encoding in the following stage. Thus, optimized GAN receives input from text feature groups and outputs the end synthesis images. Here, a research plans to train the GAN with optimization strategy via tuning the optimal weights using the Dragon Customized Whale Optimization (DC-WO) model. Finally, the superiority of the created approach is evaluated by comparing it to existing techniques. Additionally, the FID value of the proposed model using the cub dataset is 29.04%, 47.43%, 49.09%, 37.64% and 11.35%, superior to traditional FF, WOA, GWO, DA and GAN + CMAF models.
Keyword:
Text-to-image
Cross modal feature
BI-LSTM
Optimized GAN
DC-WO Model

期刊

Advances in Engineering Software 封面图
Advances in Engineering Software
IF:
5.7
论文数:
3.4K
被引数:
1.2W

机构

G
gandhi institute of technology & management (gitam)
学者数:
2.0K
论文数: 1.6K
被引数: 1
引用论文

引用论文

Adversarial text-to-image synthesis: A review
err2021-12-01
err90
errOAAI
errFrolov, Stanislav; Hinz, Tobias; Raue, Federico; Hees, Joern; Dengel, Andreas
err分享
err收藏
Grey Wolf Optimizer灰狼优化器
err2014-03-01
err1.3W
PREAI
errMirjalili, Seyedali; Mirjalili, Seyed Mohammad; Lewis, Andrew
err分享
err收藏
The Whale Optimization Algorithm鲸鱼优化算法
err2016-05-01
err9.5K
PREAI
errMirjalili, Seyedali; Lewis, Andrew
err分享
err收藏
Dualattn-GAN: Text to Image Synthesis With Dual Attentional Generative Adversarial Network
err2019-01-01
err33
errOAAI
errCai, Yali; Wang, Xiaoru; Yu, Zhihong; Li, Fu; Xu, Peirong; Li, Yueli; Li, Lixian
err分享
err收藏
err分享
err收藏
Preparation and Electrochromic Properties of Mesoporous WO<sub>3</sub> Film
err2009-08-31
err0
PREAI
errFu Liang Shang; Hai Tao Yang; Wei Lin Lin; Ling Gao
err分享
err收藏
Learning efficient text-to-image synthesis via interstage cross-sample similarity distillation
err2020-11-17
err14
PREAI
errMao, Fengling; Ma, Bingpeng; Chang, Hong; Shan, Shiguang; Chen, Xilin
err分享
err收藏
学者 查看更多内容