arrow
Return

Adjustable Model Compression Using Multiple Genetic Algorithm

delete2023-01-01
delete7
PRE
AI
J
Jose Jaena Mari Ople
T
Tai-Ming Huang
M
Ming-Chih Chiu
Y
Yi‐Ling Chen
K
Kai‐Lung Hua *
DOI:10.1109/TMM.2021.3139215delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Generative Adversarial Networks (GAN) is a popular machine learning method that possesses powerful image generation ability, which is useful for different multimedia applications (e.g., photographic filters, image editing). However, typical GAN models have a large memory footprint that limits their practical applications for resource-constrained devices (e.g., smartphones). To deploy GAN models on devices with various hardware constraints, we propose our method, AdjustableGAN, which can compress a pretrained GAN model to different compression ratios. Our method compresses GAN by performing filter-wise pruning that follows these objectives: (1) deactivate convolutional filters for minimal performance decrease, (2) reactivate convolutional filters for maximal performance increase. We implement multiple Genetic Algorithms (GA) to perform each of these objectives- Downsize GA for best filter deactivations, while Upsize GA searches for best filter reactivations. By selective utilization of Upsize/Downsize GA, we could explicitly control the compression ratio of the model. For finalization, we fine-tune the compressed output model using the training dataset of the original input model. Our experimental results show that our method can reliably compress generative networks with minimal accuracy drop compared to other state-of-the-art compression algorithms.
Keywords:
Genetic algorithms
Generative adversarial networks
Image coding
Statistics
Sociology
Computational modeling
Training
Evolutionary pruning
genetic algorithm
model compression

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

N
national taiwan university of science & technology
Scholars:
8.8K
Papers: 8.7K
Citations: 9
Cited Papers

Cited Papers

Reduced reward processing in the brains of Parkinsonian patients
err2000-11-01
err0
PREAI
errGabriella Künig; Klaus Leonhard Leenders; Chantal Martin-Sölch; John Missimer; Stefanie Magyar; Wolfram Schultz
errShare
errSave
Dehydroindigo:  A New Piece into the Maya Blue Puzzle from the Voltammetry of Microparticles Approach
err2006-03-07
err0
PREAI
errAntonio Doménech; María Teresa Doménech-Carbó; María Luisa Vázquez de Agredos Pascual
errShare
errSave
Quality-Aware Unpaired Image-to-Image Translation
err2019-10-01
err46
errOAAI
errChen, Lei; Wu, Le; Hu, Zhenzhen; Wang, Meng
errShare
errSave
errShare
errSave
researcher View more