.png){kind=icon}
返回
TensorMap: A Deep RL-Based Tensor Mapping Framework for Spatial Accelerators
.png){kind=icon}
PRE
AI
DOI：10.1109/TC.2024.3398424.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The mapping of tensor computation is a complex and important process for spatial accelerators. Today's mapping works depend on hand-tuned kernel libraries or search-based heuristics from human experts. The former is time-intensive while the latter easily leads to sub-optimal performance. In this paper, we propose TensorMap, a deep reinforcement learning (RL)-based mapping framework for tensor computations on spatial accelerators. We propose a sequential generation mode for mapping optimization and construct a coarse-grained action space to reduce the complexity of the mapping search space. An efficient policy network is devised to optimize mapping primitives in the RL-based search. We then propose a stop signal that is sampled from Bernoulli distribution to facilitate multi-level loop unrolling for spatial accelerators. Finally, a genetic algorithm is employed to further refine the optimized mappings. In the experiments, we demonstrate TensorMap's ability for different spatial accelerators with various tensor computations. On TPU, TensorMap provides 2.6x, 2.7x, and 2.4x better energy-delay product (EDP) on average compared with FlexTensor, Ansor, and AMOS respectively. On Eyeriss, TensorMap provides 2.1 x, 1.8 x, and 1.7x better EDP on average compared with FlexTensor, Ansor, and AMOS respectively.
Keyword:
Tensors
Convolution
Computers
Parallel processing
Optimization
Libraries
Hardware
Tensor computation
spatial accelerator
software mapping
reinforcement learning
期刊
IF:
3.8
论文数:
5.4K
被引数:
9.8K
机构
引用论文
Synthesis, characterization and electrochromic properties of a near infrared active conducting polymer of 1,4-di(selenophen-2-yl)-benzene.png)
Polymer
PolymerIF0
PREAI
分享收藏
分享收藏Research on the Efficiency of Wireless Power Transfer System Based on Multi-Auxiliary Transmitting Coils基于多辅助发射线圈的无线电能传输系统效率研究
PREAI
分享收藏The power of obfuscation techniques in malicious JavaScript code: A measurement study恶意JavaScript代码中混淆技术的功能: 一项测量研究
OAAI
OAAI分享收藏Assessment of occupational exposure to benzene, toluene and xylenes in urban and rural female workersChemosphere
ChemosphereIF0
PREAI
分享收藏
查看更多内容