arrow
返回

A Machine-Learning-Based Framework for Productive Locality Exploitation

delete2021-06-01
delete2
PRE
AI
E
Engin Kayraklioglu *
T
Tarek El‐Ghazawi
DOI:10.1109/TPDS.2021.3051348delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data locality is of extreme importance in programming distributed-memory architectures due to its implications on latency and energy consumption. Automated compiler and runtime system optimization studies have attempted to improve data locality exploitation without burdening the programmer. However, due to the difficulty of static code analysis, conservatism in compiler optimizations to avoid errors, and cost of dynamic analysis, the efficacy of automated optimizations is limited. Therefore, programmers need to spend significant effort in optimizing locality while creating applications for distributed memory parallel systems. We present a machine-learning based framework to automatically exploit locality in distributed memory applications. This framework takes application source whose time-critical blocks are marked by pragmas, and produces optimized source code that uses a regressor for efficient data movement. The regressor is trained with automatically-collected application profiles with very small input data sizes. We integrate our prototype in the Chapel language stack. In our experiments, we show that the Elastic Net model is the ideal regressor for our case and applications that utilize Elastic Net can perform very similarly to programmer-optimized versions. We also show that such regressors can be trained within few minutes on a cluster or within 30 minutes on a workstation, including data collection.
Keyword:
Optimization
Reactive power
Programming
Runtime
Program processors
Productivity
Prefetching
Data locality
distributed memory
programming models
machine learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

U
universite gustave-eiffel
学者数:
5.6K
论文数: 4.8K
被引数: 5
G
George Washington University
学者数:
1.6W
论文数: 1.4W
被引数: 1.7W
引用论文

引用论文

Tailored supramolecular gel and microemulsion crystallization strategies – is isoniazid really monomorphic?
err2018-01-01
err0
errOAAI
errStuart R. Kennedy; Christopher D. Jones; Dmitry S. Yufit; Catherine E. Nicholson; Sharon J. Cooper; Jonathan W. Steed
err分享
err收藏
Trends in Data Locality Abstractions for HPC Systems
err2017-10-01
err62
errOAAI
errUnat, Didem; Dubey, Anshu; Hoefler, Torsten; Shalf, John; Abraham, Mark; Bianco, Mauro; Chamberlain, Bradford L.; Cledat, Romain; Edwards, H. Carter; Finkel, Hal; Fuerlinger, Karl; Hannig, Frank; Jeannot, Emmanuel; Kamil, Amir; Keasler, Jeff; Kelly, Paul H. J.; Leung, Vitus; Ltaief, Hatem; Maruyama, Naoya; Newburn, Chris J.; Pericas, Miquel
err分享
err收藏
Bagging predictorsBagging预测器
err1996-08-01
err1.0W
PREAI
errBreiman, L
err分享
err收藏
Xanthogranuloma of the sellar region: a systematic review
err2023-01-25
err0
PREAI
errFernando Guerrero-Pérez; Agustina Pia Marengo; Nuria Vilarrasa; Noemi Vidal; Nuria Ruiz-Roig; Juan José Sánchez-Fernández; Alberto Torres-Díaz; José Luis Sanmillán; Manuel Pérez-Maraver; Carles Villabona
err分享
err收藏
err分享
err收藏
err2000-01-01
err0
PREAI
errPeter Gouras; Cynthia MacKay
err分享
err收藏
学者 查看更多内容