arrow
返回

Machine Learning Hardware Design for Efficiency, Flexibility, and Scalability [Feature]

delete2023-01-01
delete2
PRE
AI
Z
Zhang Jie-Fang *
Z
Zhengya Zhang
DOI:10.1109/MCAS.2023.3302390delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The widespread use of deep neural networks (DNNs) and DNN-based machine learning (ML) methods justifies DNN computation as a workload class itself. Beginning with a brief review of DNN workloads and computation, we provide an overview of single instruction multiple data (SIMD) and systolic array architectures. These two basic architectures support the kernel operations for DNN computation, and they form the core of many flexible DNN accelerators. To enable a higher performance and efficiency, sparse DNN hardware can be designed to gain from data sparsity. We present common approaches from compressed storage to processing sparse data to reduce memory and bandwidth usage and improve energy efficiency and performance. To accommodate the fast evolution of new models of larger size and higher complexity, modular chiplet integration can be a promising path to meet the growing needs. We show recent work on homogeneous tiling and heterogeneous integration to scale up and scale out hardware to support larger models of more complex functions.
Keyword:
Surveys
Scalability
Multichip modules
Artificial neural networks
Machine learning
Bandwidth
Tutorials
Design engineering
Hardware design languages
ML hardware
DNN accelerator
sparse DNN architecture
DNN chiplet
heterogeneous integration

期刊

IEEE Circuits and Systems Magazine 封面图
IEEE Circuits and Systems Magazine
IF:
3.5
论文数:
525
被引数:
1.3K

机构

U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
引用论文

引用论文

err分享
err收藏
Quantification of the Conditioning Phase in Cooled Pixelated TlBr Detectors
err2015-08-01
err0
PREAI
errWill Koehler; Zhong He; Sean O'Neal; Hao Yang; Hadong Kim; Leonard Cirignano; Kanai Shah
err分享
err收藏
err分享
err收藏
Chemistry and electronic properties of ferromagnetic metal‐organic semiconductor interfaces: Fe on CuPc
err2009-12-07
err0
PREAI
errV. Yu. Aristov; O. V. Molodtsova; Yu. A. Ossipyan; B. P. Doyle; S. Nannarone; M. Knupfer
err分享
err收藏
Migration Inhibitory Factor Induces Killing ofLeishmania majorby Macrophages: Dependence on Reactive Nitrogen Intermediates and Endogenous TNF-α
err1998-09-01
err0
errOAAI
errStefan Jüttner; Jürgen Bernhagen; Christine N. Metz; Martin Röllinghoff; Richard Bucala; André Gessner
err分享
err收藏
Major Adverse Limb Events and Mortality in Patients With Peripheral Artery Disease
err2018-05-01
err0
errOAAI
errSonia S. Anand; Francois Caron; John W. Eikelboom; Jackie Bosch; Leanne Dyal; Victor Aboyans; Maria Teresa Abola; Kelley R.H. Branch; Katalin Keltai; Deepak L. Bhatt; Peter Verhamme; Keith A.A. Fox; Nancy Cook-Bruns; Vivian Lanius; Stuart J. Connolly; Salim Yusuf
err分享
err收藏
err分享
err收藏
学者 查看更多内容