Modeling programs hierarchically with stack-augmented LSTM

Fang Liu

doi:10.1016/j.jss.2020.110547

Return

Modeling programs hierarchically with stack-augmented LSTM

2020-06-01

刘枋 (Fang Liu)

Lu Zhang

Zhi Jin *

DOI：10.1016/j.jss.2020.110547

Original

Save

View PDF

Abstract

En 中文

Programming language modeling has attracted extensive attention in recent years, and it plays an essential role in program processing fields. Statistical language models, which are initially designed for natural languages, have been generally used for modeling programming languages. However, different from natural languages, programming languages contain explicit and hierarchical structure that is hard to learn by traditional statistical language models. To address this challenge, we propose a novel Stack-Augmented LSTM neural network for programming language modeling. Adding a stack memory component into the LSTM network enables our model to capture the hierarchical information of programs through the PUSH and POP operations, which further allows our model capturing the long-term dependency in the programs. We evaluate the proposed model on three program analysis tasks, i.e., code completion, program classification, and code summarization. Evaluation results show that our proposed model outperforms baseline models in all the three tasks, indicating that by capturing the structural information of programs with a stack, our proposed model can represent programs more precisely. (C) 2020 Elsevier Inc. All rights reserved.

Keywords:

Programming language modeling

Hierarchical structure

Deep learning

Software engineering

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.