arrow
Return

Tiling Parameters Prediction Using Machine Learning Techniques

delete2026-01-01
delete0
PRE
AI
M
Maksim Berezov *
C
Corinne Ancourt
M
Mikhail Kashchenko
DOI:10.1007/978-3-032-02436-7_5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The tiling transformation is one of the most crucial code optimization techniques to expose data locality and parallelism. The main idea is to split the initial iteration space into blocks and traverse them in a special order. This transformation is parametric and very sensitive to parameter tuning. Poor parameter tuning can lead to much lower performance than the initial code. Existing state-of-the-art solutions consider a restricted list of parameters to handle this issue and guarantee safe solutions. Our work proposes solutions that go beyond current state-of-the-art techniques and gain additional speedup considering a larger set of options for tiling. Our approach is based on Machine Learning methods and automatically derives heuristics to tune tiling parameters. We can predict: 1) the optimal partitioning matrix of the iteration space 2) the tile sizes, 3) the optimal directions for scanning inter-tiles, 4) the optimal directions for scanning intra-tile elements. The optimal selection of these parameters is crucial especially for programs that have data dependencies. We introduce sets of features that feed our models in their predictions. The first set encodes data dependencies, the second one captures the level of parallelism and data locality in a code. The third one aggregates information about the iteration space. Our approach surpasses existing feature spaces for tiling parameters prediction. Moreover, it could be used in conjunction with auto-tuners to iterate through the iterative search.
Keywords:
code optimization
compilation
source-to-source transformations
machine learning
loop tiling
data-dependencies
feature space design

Journal

L
LANGUAGES AND COMPILERS FOR PARALLEL COMPUTING, LCPC 2023
IF:
0
Papers:
14
Citations:
0

Organization

U
Universite PSL
Scholars:
3.3W
Papers: 2.5W
Citations: 91
Cited Papers

Cited Papers

OpenTuner
err2014-08-24
err0
errOAAI
errJason Ansel; Shoaib Kamil; Kalyan Veeramachaneni; Jonathan Ragan-Kelley; Jeffrey Bosboom; Una-May O'Reilly; Saman Amarasinghe
errShare
errSave
errShare
errSave
Analytical Bounds for Optimal Tile Size Selection
err2012-01-01
err0
PREAI
errJun Shirako; Kamal Sharma; Naznin Fauzia; Louis-Noël Pouchet; J. Ramanujam; P. Sadayappan; Vivek Sarkar
errShare
errSave
Minimal data dependence abstractions for loop transformations
err2005-06-09
err0
PREAI
errYi-Qing Yang; Corinne Ancourt; François Irigoin
errShare
errSave
Tile size selection revisited
err2013-12-01
err0
errOAAI
errSanyam Mehta; Gautham Beeraka; Pen-Chung Yew
errShare
errSave
A scalable auto-tuning framework for compiler optimization
err2009-05-01
err0
errOAAI
errAnanta Tiwari; Chun Chen; Jacqueline Chame; Mary Hall; Jeffrey K. Hollingsworth
errShare
errSave
Automatic creation of tile size selection models
err2010-04-24
err0
PREAI
errTomofumi Yuki; Lakshminarayanan Renganarayanan; Sanjay Rajopadhye; Charles Anderson; Alexandre E. Eichenberger; Kevin O'Brien
errShare
errSave
researcher View more