arrow
返回

PTcomp: Post-Training Compression Technique for Generative Adversarial Networks

delete2023-01-01
delete0
delete
OA
AI
D
Dina Tantawy *
M
Mohamed Zahran
A
Amr G. Wassal
DOI:10.1109/ACCESS.2023.3239786delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In a time of virtual spaces, the usage of generative adversarial networks is inevitable. Generative adversarial networks (GANs) are generative deep-learning models that can generate realistic data. GANs have been used in many applications like text-to-image, image-to-image, image synthesis, speech synthesis, etc. Its power lies in the diversity and novelty of the generated data. Despite their advantages, GANs are resource-hungry. GANs' output resolution and high correlation make it more challenging to compress and fit on edge-devices storage and power budget. Hence, traditional compression techniques are not the best fit to use with GANs. Additionally, GANs training instability adds another dimension of difficulty. Therefore, compression techniques that require retraining are challenging for GANs. In this paper, we developed a weight clustering technique to compress GANs without the need for retraining, hence the name post-training compression technique (PTcomp). We also proposed a clustered-based pruning which adds more savings. Experiments on Cyclegan, Deep convolution gan (DCGAN), and Stargan using several datasets show the superiority of our technique against traditional post-training quantization. Our technique provides a 4x to 8x compression ratio with comparable quality to original models and 14% fewer mac operations due to pruning.
Keyword:
Generative adversarial networks
Generators
Quantization (signal)
Training
Mathematical models
Clustering algorithms
Tensors
Compression
deep-learning
generative adversarial networks
post-training
clustering
pruning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

E
egyptian knowledge bank (ekb)
学者数:
11.6W
论文数: 9.3W
被引数: 84
C
Cairo University
学者数:
1.4W
论文数: 1.1W
被引数: 1.7W
引用论文

引用论文

Biosynthesis of lead selenide quantum rods in marine Aspergillus terreus
err2014-06-01
err0
PREAI
errJaya Mary Jacob; Raj Mohan Balakrishnan; Udaya Bhat Kumar
err分享
err收藏
Oligomycin and antimycin A prevent nitric oxide–induced apoptosis by blocking cytochrome C leakage
err2004-03-01
err0
PREAI
errNaohiro Dairaku; Katsuaki Kato; Kennichi Honda; Tomoyuki Koike; Katsunori Iijima; Akira Imatani; Hitoshi Sekine; Shuichi Ohara; Hiroshi Matsui; Tooru Shimosegawa
err分享
err收藏
err分享
err收藏
Wisdom of the crowds: A suggested polygenic plan for small-RNA-mediated regulation in bacteria
err2021-10-01
err0
errOAAI
errOmer Goldberger; Jonathan Livny; Roby Bhattacharyya; Orna Amster-Choder
err分享
err收藏
Vigorous exercise as a triggering mechanism for late stent thrombosis: A description of three cases
err2009-11-23
err0
PREAI
errBastiaan Zwart; Tjitske C. Van Kerkvoorde; Jochem W. Van Werkum; Nicoline J. Breet; Jurriën M. Ten Berg; Arnoud W. J. Van ‘T Hof
err分享
err收藏
学者 查看更多内容