.png){kind=icon}
返回
Dataflow optimization with layer-wise design variables estimation method for enflame CNN accelerators
.png){kind=icon}
PRE
AI
DOI：10.1016/j.jpdc.2024.104869.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
As convolution layers have been proved to be the most time-consuming operation in convolutional neural network (CNN) algorithms, many efficient CNN accelerators have been designed to boost the performance of convolution operations. Previous works on CNN acceleration usually use fixed design variables for diverse convolutional layers, which would lead to inefficient data movements and low utilization of computing resource. We tackle this issue by proposing a flexible dataflow optimization method with design variables estimation for different layers. The optimization method first narrows the design space by the priori constraints, and then enumerates all legal solutions to select the optimal design variables. We demonstrate the effectiveness of the proposed optimization method by implementing representative CNN models (VGG-16, ResNet-18 and MobileNet V1) on Enflame Technology's programmable CNN accelerator, General Computing Unit (GCU). The results indicate that our optimization can significantly enhance the throughput of the convolution layers in ResNet, VGG and MobileNet on GCU, with improvement of up to 1.84x. Furthermore, it achieves up to 2.08x of GCU utilization specifically for the convolution layers of ResNet on GCU.
Keyword:
Convolutional neural networks (CNNs)
General computing unit (GCU)
Programmable dataflow
Optimization
期刊
IF:
4
论文数:
3.8K
被引数:
4.8K
机构
引用论文
Efficient and portable GEMM-based convolution operators for deep neural network training on multicore processors基于GEMM的高效可移植卷积算子，用于多核处理器上的深度神经网络训练
OAAI
.png){kind=icon}
OAAI分享收藏You Cannot Improve What You Do not Measure: FPGA vs. ASIC Efficiency Gaps for Convolutional Neural Network Inference你无法改善你无法衡量的东西: FPGA与ASIC卷积神经网络推理的效率差距
PREAI
分享收藏An Efficient and Flexible Accelerator Design for Sparse Convolutional Neural Networks一种高效灵活的稀疏卷积神经网络加速器设计
PREAI
分享收藏 没有更多内容
没有更多内容