arrow
返回

Cumulant GAN

delete2023-11-01
delete5
PRE
AI
Y
Yannis Pantazis *
D
Dipjyoti Paul
M
Michail Fasoulakis
S
Stylianou, Yannis
M
Markos A. Katsoulakis
DOI:10.1109/TNNLS.2022.3161127delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, we propose a novel loss function for training generative adversarial networks (GANs) aiming toward deeper theoretical understanding as well as improved stability and performance for the underlying optimization problem. The new loss function is based on cumulant generating functions (CGFs) giving rise to Cumulant GAN. Relying on a recently derived variational formula, we show that the corresponding optimization problem is equivalent to Renyi divergence minimization, thus offering a (partially) unified perspective of GAN lasses: the Renyi family encompasses Kullback-Leibler divergence (KLD), reverse KLD, Hellinger distance, and chi(2)-divergence. Wasserstein GAN is also a member of cumulant GAN. In terms of stability, we rigorously prove the linear convergence of cumulant GAN to the Nash equilibrium for a linear discriminator, Gaussian distributions, and the standard gradient descent ascent algorithm. Finally, we experimentally demonstrate that image generation is more robust relative to Wasserstein GAN and it is substantially improved in terms of both inception score (IS) and Frichet inception distance (FID) when both weaker and stronger discriminators are considered.
Keyword:
Cumulant generating function (CGF)
generative adversarial networks (GANs)
image generation
Renyi divergence

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

F
foundation for research & technology - hellas (forth)
学者数:
3.0K
论文数: 2.4K
被引数: 1
U
university of massachusetts system
学者数:
3.9W
论文数: 3.6W
被引数: 42
U
University of Massachusetts Amherst
学者数:
1.1W
论文数: 8.9K
被引数: 19
U
University of Crete
学者数:
8.3K
论文数: 6.6K
被引数: 7.8K
学者 查看更多机构
引用论文

引用论文

Scavenger Effect of Experimental and Clinically Used Cardiovascular Drugs
err2001-11-01
err0
errOAAI
errZsolt Marton; Robert Halmosi; Beata Horvath; Tamas Alexy; Gabor Kesmarky; Judit Vekasi; Istvan Battyany; Kalman Hideg; Kalman Toth
err分享
err收藏
err分享
err收藏
Generative Adversarial Networks An overview生成对抗网络综述
err2018-01-01
err2.4K
errOAAI
errCreswell, Antonia; White, Tom; Dumoulin, Vincent; Arulkumaran, Kai; Sengupta, Biswa; Bharath, Anil A.
err分享
err收藏
学者 查看更多内容