arrow
返回

Specializing FGPU for Persistent Deep Learning

delete2021-07-15
delete4
delete
OA
AI
R
Rui Ma *
J
Jia-Ching Hsu
T
Tian Tan
E
Eriko Nurvitadhi
D
David Sheffield
R
Rob Pelt
M
Martin Langhammer
J
Jaewoong Sim
A
Aravind Dasu
D
Derek Chiou
DOI:10.1145/3457886delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Overlay architectures are a good way to enable fast development and debug on FPGAs at the expense of potentially limited performance compared to fully customized FPGA designs. When used in concert with hand-tuned FPGA solutions, performant overlay architectures can improve time-to-solution and thus overall productivity of FPGA solutions. This work tunes and specializes FGPU, an open source OpenCL-programmable GPU overlay for FPGAs. We demonstrate that our persistent deep learning (PDL)-FGPU architecture maintains the ease-of-programming and generality of GPU programming while achieving high performance from specialization for the persistent deep learning domain. We also propose an easy method to specialize for other domains. PDL-FGPU includes new instructions, along with micro-architecture and compiler enhancements. We evaluate both the FGPU baseline and the proposed PDL-FGPU on a modern high-end Intel Stratix 10 2800 FPGA in simulation running persistent DL applications (RNN, GRU, LSTM), and non-DL applications to demonstrate generality. PDL-FGPU requires 1.4-3x more ALMs, 4.4-6.4x more M20ks, and 1-9.5x more DSPs than baseline, but improves performance by 56-693x for PDL applications with an average 23.1% degradation on non-PDL applications. We integrated the PDL-FGPU overlay into Intel OPAE to measure real-world performance/power and demonstrate that PDL-FGPU is only 4.0-10.4x slower than the Nvidia V100.
Keyword:
Overlay
specialization
FPGA
GPU
soft GPU
persistent deep learning
RNN

期刊

ACM Transactions on Reconfigurable Technology and Systems 封面图
ACM Transactions on Reconfigurable Technology and Systems
IF:
2.8
论文数:
599
被引数:
810

机构

U
university of texas austin
学者数:
2.4W
论文数: 2.0W
被引数: 54
U
university of texas system
学者数:
18.5W
论文数: 15.6W
被引数: 210
引用论文

引用论文

Assessing Graphical Robot Aids for Interactive Co-working评估图形化机器人辅助工具在交互式协同工作中的应用
err2016-07-10
err0
errOAAI
errIveta Eimontaite; Ian Gwilt; David Cameron; Jonathan M. Aitken; Joe Rolph; Saeid Mokaram; James Law
err分享
err收藏
Human Trafficking in Correctional Institutions: A Survey of Correctional and Anti-Trafficking Leaders矫正机构中的人贩运:对矫正和反贩运领导人的调查
err2022-01-09
err0
PREAI
errCynthia Fraga Rizo; Christopher J. Wretman; Jia Luo; Tonya B. Van Deinse; Nicole Sullivan; Sarah M. Godoy; Erin A. Meehan; Rebecca J. Macy
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
General-Purpose Computing with Soft GPUs on FPGAs
err2018-01-24
err18
PREAI
errAl Kadi, Muhammed; Janssen, Benedikt; Yudi, Jones; Huebner, Michael
err分享
err收藏
学者 查看更多内容