.png){kind=icon}
返回
Analysis and Optimization of Direct Convolution Execution on Multi-Core Processors
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3283312.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Nowadays, convolutional neural networks are among the most widely used types of deep learning networks thanks to their usefulness in many application domains. There are many efforts to find methods to increase their training and inference performance and efficiency. One of the most widely used technique to implement convolution consists of flattening tensors into 2D matrices and carrying out the operation through a matrix-matrix multiplication routine, which has highly optimized implementations in high-performance libraries. However, this kind of approach uses extra time and memory to transform and store the tensors involved. For this reason, direct convolution is becoming increasingly popular. Direct convolution can be implemented as a series of nested loops iterating over tensor dimensions and it does not require extra memory. In this work, we evaluate on various multi-core CPUs the performance and scalability effects deriving from different parallelization strategies, loop organizations, and SIMD-vectorization approaches with different compilers in relation with architectural aspects. We discuss each parameter thoroughly and distill our findings in a set of heuristics that can be used to quickly achieve a high-performance implementation in accordance to the underlying hardware and the characteristics of the convolutional layer at hand. By adopting a per-layer approach, we increase performance up to 60-70% compared to a static implementation for all the layers. Moreover, our results are comparable, or even better (up to 1.67 x speedup) than matrix-matrix multiplication-based convolution in a multi-core system.
Keyword:
Convolutional neural networks
direct convolution
multi-core
multi-threading
performance evaluation
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Living on the Edge: Demography of the Slender-Billed Gull in the Western Mediterranean.png)
PLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏Author response: A primal role for the vestibular sense in the development of coordinated locomotionOAAI
IF0
OAAI分享收藏A survey on hardware accelerators: Taxonomy, trends, challenges, and perspectives硬件加速器调查: 分类、趋势、挑战和展望
OAAI
OAAI分享收藏
查看更多内容