arrow
返回

Resource-Efficient Convolutional Networks: A Survey on Model-, Arithmetic-, and Implementation-Level Techniques

delete2023-07-13
delete12
delete
OA
AI
J
Junkyu Lee
L
Lev Mukhanov
A
Amir Sabbagh Molahosseini
U
Umar Ibrahim Minhas
杨华 (Hua Yang)
J
Jesús Martínez del Rincón
K
Kiril Dichev
C
Cheol-Ho Hong *
H
Hans Vandierendonck
DOI:10.1145/3587095delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Convolutional neural networks (CNNs) are used in our daily life, including self-driving cars, virtual assistants, social network services, healthcare services, and face recognition, among others. However, deep CNNs demand substantial compute resources during training and inference. The machine learning community has mainly focused on model-level optimizations such as architectural compression of CNNs, whereas the system community has focused on implementation-level optimization. In between, various arithmetic-level optimization techniques have been proposed in the arithmetic community. This article provides a survey on resource-efficient CNN techniques in terms of model-, arithmetic-, and implementation-level techniques, and identifies the research gaps for resource-efficient CNN techniques across the three different level techniques. Our survey clarifies the influence from higher- to lower-level techniques based on our resource efficiency metric definition and discusses the future trend for resource-efficient CNN research.
Keyword:
Convolutional neural networks
neural networks
resource efficiency
arithmetic utilization

期刊

ACM Computing Surveys 封面图
ACM Computing Surveys
IF:
28
论文数:
2.4K
被引数:
3.5W

机构

Q
Queen's University Belfast
学者数:
1.6W
论文数: 1.7W
被引数: 2.5W
Q
Queen Mary University London
学者数:
2.0W
论文数: 1.5W
被引数: 327
U
University of Cambridge
学者数:
7.7W
论文数: 7.1W
被引数: 13.7W
U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
学者 查看更多机构
引用论文

引用论文

The influence of non-idealities on the thermoelectric power factor of nanostructured superlattices
err2015-12-08
err0
errOAAI
errMischa Thesberg; Mahdi Pourfath; Hans Kosina; Neophytos Neophytou
err分享
err收藏
Implications of diminished ovarian reserve (DOR) extend well beyond reproductive concerns
err2008-11-01
err0
PREAI
errLubna Pal; Kris Bevilacqua; Gohar Zeitlian; Jun Shu; Nanette Santoro
err分享
err收藏
Characterization of the Reaction Performance for Residue Hydrotreating Feedstocks
err2010-12-16
err0
PREAI
errYu-dong Sun; Chao-he Yang; Hong-hong Shan; Ben-xian Shen
err分享
err收藏
Algorithm 64: Quicksort
err1961-07-01
err0
PREAI
errC. A. R. Hoare
err分享
err收藏
学者 查看更多内容