arrow
返回

FTA-GAN: A Computation-Efficient Accelerator for GANs With Fast Transformation Algorithm

delete2023-06-01
delete9
PRE
AI
W
Wendong Mao
P
Peixiang Yang
Z
Zhongfeng Wang *
DOI:10.1109/TNNLS.2021.3110728delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Nowadays, generative adversarial network (GAN) is making continuous breakthroughs in many machine learning tasks. The popular GANs usually involve computation-intensive deconvolution operations, leading to limited real-time applications. Prior works have brought several accelerators for deconvolution, but all of them suffer from severe problems, such as computation imbalance and large memory requirements. In this article, we first introduce a novel fast transformation algorithm (FTA) for deconvolution computation, which well solves the computation imbalance problem and removes the extra memory requirement for overlapped partial sums. Besides, it can reduce the computation complexity for various types of deconvolutions significantly. Based on FTA, we develop a fast computing core (FCC) and the corresponding computing array so that the deconvolution can be efficiently computed. We next optimize the dataflow and storage scheme to further reuse on-chip memory and improve the computation efficiency. Finally, we present a computation-efficient hardware architecture for GANs and validate it on several GAN benchmarks, such as deep convolutional GAN (DCGAN), energy-based GAN (EBGAN), and Wasserstein GAN (WGAN). The experimental results show that our design can reach 2211 GOPS under 185-MHz working frequency on Intel Stratix 10SX field-programmable gate array (FPGA) board with satisfactory visual results. In brief, the proposed design can achieve more than 2x hardware efficiency improvement over previous designs, and it can reduce the storage requirement drastically.
Keyword:
Deconvolution
Generative adversarial networks
Convolution
Kernel
Hardware
Generators
Memory management
Deconvolution
fast algorithm
generative adversarial network (GAN)
hardware architecture
transposed convolution

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
引用论文

引用论文

Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors
err2008-06-01
err0
errOAAI
errXu Yuan; Jun Yao; David Norris; David D. Tran; Richard J. Bram; Gong Chen; Bernhard Luscher
err分享
err收藏
Extragenital Chlamydia and Gonorrhea Among Community Venue–Attending Men Who Have Sex with Men — Five Cities, United States, 2017
err2019-04-12
err0
errOAAI
errMichelle L. Johnson Jones; Johanna Chapin-Bardales; Destani Bizune; John R. Papp; Christi Phillips; Robert D. Kirkcaldy; Cyprian Wejnert; Kyle T. Bernstein; Salma Khuwaja; Zaida Lopez; Paige Padgett; David Forrest; Willie Nixon; Emma Spencer; Sarah Braunstein; Sidney Carrillo; Alexis Rivera; Theresa Ick; H. Fisher Raymond; Jenevieve Opoku; Irene Kuo
err分享
err收藏
err分享
err收藏
A dynamical two-dimensional traffic model in an anisotropic network
err2013-01-01
err0
errOAAI
errTibye Saumtally; Jean-Patrick Lebacque; Habib Haj-Salem
err分享
err收藏
学者 查看更多内容