arrow
返回

Data scheduling and placement in deep learning accelerator

delete2021-07-10
delete5
PRE
AI
S
Seyedeh Yasaman Hosseini Mirmahaleh
M
Midia Reshadi *
N
Nader Bagherzadeh
A
Ahmad Khademzadeh
DOI:10.1007/s10586-021-03355-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep neural networks (DNNs) have been employed to different devices as a popular machine learning algorithm (ML) owing to deploy the Internet of Things (IoT), data mining in cloud computing, and web search engines, which MLs had an impressive effect on IoT's edge level nodes. Deploying DNN-based applications leads to memory access problems, including communication delay, energy efficiency, and bandwidth requirement. We propose a bus scheduling for data placement on distributed local buffers in a deep learning accelerator (DLA). The contributions of this paper include (1) providing a method for data-flow mapping between off-chip DRAM and distributed local buffers, and a flow mapping approach for data transfer between distributed local buffers and processing elements (PEs) (2) employing distributed local buffers in four directions for traffic distribution on a mesh based on memory access mechanism (3) bus scheduling for data placement on distributed local buffers. Simulated experiment based on typical DNN (i.e., AlexNet, VGG-16, and GoogLeNet) workflows demonstrates the effectiveness of the design: (1) the scheduling and mapping methods improve total runtime and bandwidth requirement by approximately 42.29% and 88.95% compared with TPU, respectively. Additionally, (2) our methods reduce total runtime for row-column stationary plus by approximately 99% compared with weight-stationary data-flow in CONV1 and CONV11 of VGG-16, respectively. This work reports the simulation results based on distributing AlexNet, VGG-16, and GoogLeNet's traffics as the popular CNNs and DNNs models, whereas it investigates our method's efficiency for other trained models.
Keyword:
Deep Neural Network (DNN)
Networks-on-Chip (NoC)
Bus scheduling
Flow mapping
Traffic distribution
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
论文数:
5.1K
被引数:
7.5K

机构

I
Islamic Azad University
学者数:
4.0W
论文数: 3.3W
被引数: 9.8K
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
U
university of california irvine
学者数:
2.3W
论文数: 1.7W
被引数: 55
学者 查看更多机构
引用论文

引用论文

Defect structure in the alkali gallate fast ion conductors
err1981-10-01
err0
PREAI
errM.P. Anderson; L.M. Foster; S.J. La Placa
err分享
err收藏
err分享
err收藏
Aspergillus tubingensis Is a Pre-Emergent Pathogen of Date Palm Seedlings
err2020-12-14
err0
errOAAI
errMaryam Alomran; Jos Houbraken; George Newcombe
err分享
err收藏
A Self-Powered Triboelectric Nanosensor for PH Detection
err2016-01-01
err0
errOAAI
errYing Wu; Yuanjie Su; Junjie Bai; Guang Zhu; Xiaoyun Zhang; Zhanolin Li; Yi Xiang; Jingliang Shi
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容