arrow
Return

Sequence generative adversarial nets with a conditional discriminator

delete2021-03-01
delete8
PRE
AI
Y
Yongfei Yan
G
Gehui Shen
S
Song Zhang
T
Ting Huang
邓志鸿 cover
邓志鸿 (Zhihong Deng) *
U
Unil Yun
DOI:10.1016/j.neucom.2020.10.108delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The success of Generative Adversarial Networks (GANs) in image generation attracts researchers to design sequence GANs in text generation. However, the discriminators of those sequence GANs usually provide only one signal per sequence, which can not reflect detailed information, e.g. whether a token is appropriate in a sequence. In addition, maximum likelihood pre-training is typically used in those models, which is time-consuming and obscures the effects of adversarial training. To cope with these problems, we propose a new sequence GAN that consists of a conditional discriminator and a discriminator-augmented generator. The conditional discriminator provides a sequence with token level signals. The generator is designed to approximate a discriminator-augmented distribution, which avoids pre-training. Experiments show that the conditional discriminator provides more informative guidance, and our model outperforms existing models according to metrics involving both sampling quality and sampling diversity. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Text generation
Adversarial neural networks
Natural language processing
Deep learning
Algorithm
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

S
Sejong University
Scholars:
8.3K
Papers: 1.1W
Citations: 1.5W
P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146