.png){kind=icon}
返回
Efficient and Fast High-Performance Library Generation for Deep Learning Accelerators
.png){kind=icon}
PRE
AI
DOI：10.1109/TC.2024.3475575.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The widespread adoption of deep learning accelerators (DLAs) underscores their pivotal role in improving the performance and energy efficiency of neural networks. To fully leverage the capabilities of these accelerators, exploration-based library generation approaches have been widely used to substantially reduce software development overhead. However, these approaches have been challenged by issues related to sub-optimal optimization results and excessive optimization overheads. In this paper, we propose Heron to generate high-performance libraries of DLAs in an efficient and fast way. The key is automatically enforcing massive constraints through the entire program generation process and guiding the exploration with an accurate pre-trained cost model. Heron represents the search space as a constrained satisfaction problem (CSP) and explores the space via evolving the CSPs. Thus, the sophisticated constraints of the search space are strictly preserved during the entire exploration process. The exploration algorithm has the flexibility to engage in space exploration using either online-trained models or pre-trained models. Experimental results demonstrate that Heron averagely achieves 2.71$\times$x speedup over three state-of-the-art automatic generation approaches. Also, compared to vendor-provided hand-tuned libraries, Heron achieves a 2.00$\times$x speedup on average. When employing a pre-trained model, Heron achieves 11.6$\times$x compilation time speedup, incurring a minor impact on execution time.
Keyword:
Optimization
Space exploration
Schedules
Libraries
Biological cells
Deep learning
Costs
Computers
Search problems
Tensors
Code generation
compiler optimization
tensor computation
期刊
IF:
3.8
论文数:
5.4K
被引数:
9.8K
机构
引用论文
Oil–water two-phase flow measurement with combined ultrasonic transducer and electrical sensors
.png){kind=icon}
PREAI
分享收藏
分享收藏
查看更多内容