.png){kind=icon}
返回
Context-aware code generation with synchronous bidirectional decoder
.png){kind=icon}
PRE
AI
DOI：10.1016/j.jss.2024.112066.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Code generation aims to map natural language descriptions to code snippets. Recent approaches using sequence -to -tree models have shown promising results. However, they generally adopt an autoregressive way to predict the next token based on previous ones and do not consider potential future tokens. To address this issue, we propose Contextor, a novel context -sensitive model employing a bidirectional decoder to generate tokens in two different orders synchronously and interactively. Specifically, we employ two decoders to generate two sequences of different traversals and share their context knowledge via the attention mechanism. As a result, our model can synthesize both previous and future information simultaneously. To alleviate the information leakage problem caused by the teacher -forcing training strategy and bidirectional decoding, we propose an adapted scheduled sampling technique to prevent the decoders from contacting the actual label. Furthermore, Contextor also features a bidirectional beam search algorithm to better interact with both decoders. Experimental results demonstrate that our approach outperforms the state-of-the-art baselines.
Keyword:
Code generation
Transition system
Bidirectional decoder
Neural network
期刊
IF:
4.1
论文数:
5.5K
被引数:
8.4K
机构
引用论文
.png){kind=icon}
CodeGRU: Context-aware deep learning with gated recurrent unit for source code modelingCodeGRU: 具有用于源代码建模的门控循环单元的上下文感知深度学习
PREAI
分享收藏分享收藏 没有更多内容
没有更多内容