arrow
Return

Profile Generation for GPU Targets

delete2026-01-01
delete0
PRE
AI
E
Ethan Luis Mcdonough *
J
Joel Denny
J
Johannes Doerfert
DOI:10.1007/978-3-032-06343-4_7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
GPU accelerators are ubiquitous, but their ecosystem is far less evolved than the host one. Compiler heuristics are often tuned for CPUs and reused for GPU. Similarly, tooling and more evolved optimization techniques are historically not available on GPU targets. In this work, we address one of these shortcomings and enable profile generation and profile-guided optimizations (PGO) for GPU targets. While this is only a single step towards a CPU equivalent ecosystem for offload devices, it shows how old misconceptions on the limitations of GPUs are often not warranted anymore. Through our implementation in LLVM/Offload, we enable device-side PGO for full scientific applications and open up tooling opportunities, including code coverage analysis and compiler-built-in roofline analysis. Our evaluation highlights the performance implications of profile generation, the insights gained from these profiles, and the (missed) opportunities in utilizing the information for GPU compilation.
Keywords:
PGO
GPU
Offloading
Profiling
Roofline

Journal

O
OPENMP: BALANCING PRODUCTIVITY AND PERFORMANCE PORTABILITY, IWOMP 2025
IF:
0
Papers:
14
Citations:
0

Organization

L
lawrence livermore national laboratory
Scholars:
528
Papers: 205
Citations: 0
U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246