arrow
Return

Non-Autoregressive Line-Level Code Completion

delete2024-06-03
delete3
delete
OA
AI
F
Fang Liu
Z
Zhiyi Fu
G
Ge Li
Z
Zhi Jin
刘辉 cover
刘辉 (Hui Liu)
Y
Yiyang Hao
L
Li Zhang *
DOI:10.1145/3649594delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Software developers frequently use code completion tools to accelerate software development by suggesting the following code elements. Researchers usually employ AutoRegressive (AR) decoders to complete code sequences in a left-to-right, token-by-token fashion. To improve the accuracy and efficiency of code completion, we argue that tokens within a code statement have the potential to be predicted concurrently. In this article, we first conduct an empirical study to analyze the dependency among the target tokens in line-level code completion. The results suggest that it is potentially practical to generate all statement tokens in parallel. To this end, we introduce SANAR, a simple and effective syntax-aware non-autoregressive model for line-level code completion. To further improve the quality of the generated code, we propose an adaptive and syntax-aware sampling strategy to boost the model's performance. The experimental results obtained from two widely used datasets indicate that our model outperforms state-of-the-art code completion approaches of similar model size by a considerable margin, and is faster than these models with up to 9x speed-up. Moreover, the extensive results additionally demonstrate that the enhancements achieved by SANAR become even more pronounced with larger model sizes, highlighting their significance.
Keywords:
Code completion
neural networks
non-autoregressive generation

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
B
beijing institute of technology
Scholars:
5.5W
Papers: 4.0W
Citations: 63
P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
researcher View more organizations
Cited Papers

Cited Papers

Ca2+ Activated K Channels-New Tools to Induce Cardiac Commitment from Pluripotent Stem Cells in Mice and Men
err2011-10-26
err0
PREAI
errMartin Müller; Marianne Stockmann; Daniela Malan; Anne Wolheim; Michael Tischendorf; Leonhard Linta; Sarah-Fee Katz; Qiong Lin; Stephan Latz; Cornelia Brunner; Anna M. Wobus; Martin Zenke; Maria Wartenberg; Tobias M. Boeckers; Götz von Wichert; Bernd K. Fleischmann; Stefan Liebau; Alexander Kleger
errShare
errSave
Comparison of sub‐ versus suprafascially raised anterolateral thigh free flaps with regard to donor‐site morbidity, function and aesthetics
err2017-11-20
err0
PREAI
errSebastian Fischer; Yannick Diehm; Christoph Hirche; Thomas Kremer; Adrien Daigeler; Ulrich Kneser; J. Frederick Hernekamp
errShare
errSave
High-Throughput Liquid Chromatography–Tandem Mass Spectrometry Quantification of Glycosaminoglycans as Biomarkers of Mucopolysaccharidosis II
err2020-07-30
err0
errOAAI
errJunhua Wang; Akhil Bhalla; Julie C. Ullman; Meng Fang; Ritesh Ravi; Annie Arguello; Elliot Thomsen; Buyankhishig Tsogtbaatar; Jing L. Guo; Lukas L. Skuja; Jason C. Dugas; Sonnet S. Davis; Suresh B. Poda; Kannan Gunasekaran; Simona Costanzo; Zachary K. Sweeney; Anastasia G. Henry; Jeffrey M. Harris; Kirk R. Henne; Giuseppe Astarita
errShare
errSave
Ladle furnace slag as cement replacement in mortar mixes
err2019-01-01
err0
errOAAI
errAmaia Santamaria; Vanesa Ortega-Lopez; Marta Skaf; Veronica García; Juan Gaitero; Jose San-Jose; Javier González
errShare
errSave
A Microbial Ecosystem: Agricultural Jiaosu Achieves Effective and Lasting Antifungal Activity against Botrytis Cinerea
err
IF0
err2020-12-04
err0
errOAAI
errYue Zhang; Youhui Gao; Zehui Zheng; Xingyao Meng; Yafan Cai; Jianbin Liu; Yuegao Hu; Shuangdui Yan; Xiaofen Wang
errShare
errSave
researcher View more