.png){kind=icon}
返回
A syntax-guided multi-task learning approach for Turducken-style code generation
.png){kind=icon}
PRE
AI
DOI：10.1007/s10664-023-10372-1.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Due to the development of pre-trained language models, automated code generation techniques have shown great promise in recent years. However, the generated code will not always adhere to syntactic constraints of the target language, especially in the case of Turducken-style code, where declarative code snippets are embedded within imperative programs. In this study, we summarize three significant challenges in regards to syntactic constraints: (1) the efficient representation of syntactic constraints, (2) the effective integration of syntactic information, and (3) the scalable syntax-first decoding algorithm. To address these challenges, we propose a syntax-guided multi-task learning approach TurduckenGen. Specifically, we first explicitly append the type information to the code tokens to capture the representation of syntactic constraints. Then we formalize code generation with syntactic constraint representation as an auxiliary task to enable the model to learn the syntactic constraints of the code. Finally, the syntactically correct code is selected accurately from the multiple candidates with the help of the compiler feedback. Extensive experiments and comprehensive analysis demonstrate the effectiveness and general applicability of our approach after being compared with six state-of-the-art baselines on two Turducken-style code datasets. Finally, we conducted a human study and found the code quality generated by our approach is better than baselines in terms of code readability and semantic similarity.
Keyword:
Syntactically-constrained code generation
Turducken-style code
Multi-task learning
CodeT5
Abstract syntax tree
期刊
IF:
3.6
论文数:
2.0K
被引数:
5.3K
机构
引用论文
分享收藏ExploitGen: Template-augmented exploit code generation based on CodeBERTExploitGen: 基于CodeBERT的模板增强漏洞代码生成
PREAI
分享收藏Assessing the tensile shear strength and interfacial bonding mechanism of poplar plywood with high-density polyethylene films as adhesive.png)
BioResources
OAAI
BioResourcesIF0
OAAI分享收藏Effects of a restrictive fluid regimen in pediatric patients undergoing major abdominal surgery
PREAI
分享收藏
查看更多内容