arrow
Return

Supersonic: Learning to Generate Source Code Optimizations in C/C plus

delete2024-11-01
delete0
delete
OA
AI
Z
Zimin Chen *
S
Sen Fang
M
Martin Monperrus
DOI:10.1109/TSE.2024.3423769delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Software optimization refines programs for resource efficiency while preserving functionality. Traditionally, it is a process done by developers and compilers. This paper introduces a third option, automated optimization at the source code level. We present Supersonic , a neural approach targeting minor source code modifications for optimization. Using a seq2seq model, Supersonic is trained on C/C++ program pairs ( x(t) , x(t+1) ), where x(t+1) is an optimized version of x(t) , and outputs a diff. Supersonic 's performance is benchmarked against OpenAI's GPT-3.5-Turbo and GPT-4 on competitive programming tasks. The experiments show that Supersonic not only outperforms both models on the code optimization task but also minimizes the extent of the change with a model more than 600x smaller than GPT-3.5-Turbo and 3700x smaller than GPT-4.
Keywords:
Optimization
Codes
Training
Source coding
Task analysis
Decoding
Vectors
Code optimization
Seq2Seq learning
large language model

Journal

IEEE Transactions on Software Engineering cover
IEEE Transactions on Software Engineering
IF:
5.6
Papers:
2.9K
Citations:
1.1W

Organization

R
Royal Institute of Technology
Scholars:
1.8W
Papers: 1.8W
Citations: 25
Cited Papers

Cited Papers

Mechanism of action of a yeast activator: Direct effect of GAL4 derivatives on mammalian TFIID-promoter interactions
errCell
IF0
err1988-08-01
err0
PREAI
errMasami Horikoshi; Michael F. Carey; Hitoshi Kakidani; Robert G. Roeder
errShare
errSave
Complementary chromosome folding by transcription factors and cohesin
err
IF0
err2018-04-23
err0
PREAI
errM. C. F. Pereira; C. A. Brackley; D. Michieletto; C. Annunziatella; S. Bianco; A. M. Chiariello; M. Nicodemi; D. Marenduzzo
errShare
errSave
Land cover influences on juvenile Rainbow Trout diet composition and condition in Lake Michigan tributaries
err2018-06-27
err0
errOAAI
errKyle J. Brumm; Jory L. Jonas; Carson G. Prichard; Nicole M. Watson; Kevin L. Pangle
errShare
errSave
A Survey on Compiler Autotuning using Machine Learning
err2018-09-18
err123
errOAAI
errAshouri, Amir H.; Killian, William; Cavazos, John; Palermo, Gianluca; Silvano, Cristina
errShare
errSave
Parameter-efficient fine-tuning of large-scale pre-trained language models
err2023-03-02
err139
errOAAI
errDing, Ning; Qin, Yujia; Yang, Guang; Wei, Fuchao; Yang, Zonghan; Su, Yusheng; Hu, Shengding; Chen, Yulin; Chan, Chi-Min; Chen, Weize; Yi, Jing; Zhao, Weilin; Wang, Xiaozhi; Liu, Zhiyuan; Zheng, Hai-Tao; Chen, Jianfei; Liu, Yang; Tang, Jie; Li, Juanzi; Sun, Maosong
errShare
errSave
errShare
errSave
Machine Learning in Compiler Optimization
err2018-11-01
err110
errOAAI
errWang, Zheng; O'Boyle, Michael
errShare
errSave
researcher View more