arrow
Return

Automated High-Level Code Optimization for Warehouse Performance

delete
delete0
PRE
AI
A
Alexander Shypula
A
Aman Madaan
Y
Yimeng Zeng
U
Uri Alon
J
Jacob R. Gardner
M
Milad Hashemi
G
Graham Neubig
P
Parthasarathy Ranganathan
O
Osbert Bastani
A
Amir Yazdanbakhsh
DOI:10.1109/MM.2025.3590033delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the twilight of Moore’s law, optimizing program performance has emerged as a central focus in computer architecture research. Yet, high-level source optimization remains challenging due to the intricate nature of understanding code semantics. Our approach unifies machine learning techniques with established insights and tools from computer architecture to tackle the inherent challenges of high-level optimization. In this work, we introduce a framework that harnesses large language models (LLMs) for high-level program optimization. We curate a dataset of competitive C++ submissions, each accompanied by extensive unit tests to capture performance-improving patterns. To mitigate the variability of performance measurements, we develop an evaluation harness using the gem5 full-system simulator. Our results show a mean speedup of 6.86, outperforming the average human optimization of 3.66×. We also give an overview of subsequent work in this space, describing how LLM-driven optimization enables autonomously applying performance-improving edits across billions of lines of code in Google data centers.
Keywords:
Optimization
Codes
Training
Programming
Adaptation models
Semantics
Benchmark testing
Synthetic data
Performance evaluation
C++ languages
Moore's Law
Warehousing
Performance evaluation

Journal

IEEE Micro cover
IEEE Micro
IF:
2.9
Papers:
113
Citations:
2.7K

Organization

G
google deepmind., mountain view, ca, usa
Scholars:
9
Papers: 3
Citations: 0
C
Carnegie Mellon University
Scholars:
1.4W
Papers: 1.4W
Citations: 2.7W
U
university of pennsylvania
Scholars:
9.2W
Papers: 7.8W
Citations: 153
X
xai, palo alto, ca, usa
Scholars:
2
Papers: 2
Citations: 0
G
google, mountain view, ca, usa
Scholars:
11
Papers: 4
Citations: 0
researcher View more organizations