.png){kind=icon}
返回
A Survey on Large Language Models for Code Generation
.png){kind=icon}
PRE
AI
DOI：10.1145/3747588.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Large Language Models (LLMs) have garnered remarkable advancements across diverse code-related tasks, known as Code LLMs, particularly in code generation that generates source code with LLM from natural language descriptions. This burgeoning field has captured significant interest from both academic researchers and industry professionals due to its practical significance in software development, e.g., GitHub Copilot. Despite the active exploration of LLMs for a variety of code tasks, either from the perspective of Natural Language Processing (NLP) or Software Engineering (SE) or both, there is a noticeable absence of a comprehensive and up-to-date literature review dedicated to LLM for code generation. In this survey, we aim to bridge this gap by providing a systematic literature review that serves as a valuable reference for researchers investigating the cutting-edge progress in LLMs for code generation. We introduce a taxonomy to categorize and discuss the recent developments in LLMs for code generation, covering aspects such as data curation, latest advances, performance evaluation, ethical implications, environmental impact, and real-world applications. In addition, we present a historical overview of the evolution of LLMs for code generation and provide a quantitative and qualitative comparative analysis of experimental results of code LLMs, sourced from their original papers to ensure a fair comparison on the HumanEval, MBPP, and BigCodeBench benchmarks, across various levels of difficulty and types of programming tasks, to highlight the progressive enhancements in LLM capabilities for code generation. We identify critical challenges and promising opportunities regarding the gap between academia and practical development. Furthermore, we have established a dedicated resource GitHub page (https://github.com/juyongjiang/CodeLLMSurvey) to continuously document and disseminate the most recent advances in the field.
Keyword:
Large Language Models
Code Large Language Models
Code Generation
期刊
A
IF:
6.2
论文数:
1.2K
被引数:
3.4K
机构
引用论文
Style-Analyzer: Fixing Code Style Inconsistencies with Interpretable Unsupervised AlgorithmsStyle-Analyzer：使用可解释的无监督算法修复代码风格不一致
OAAI
.png){kind=icon}
OAAI分享收藏Software Testing With Large Language Models: Survey, Landscape, and Vision使用大型语言模型进行软件测试: 调查，景观和视觉
OAAI
OAAI分享收藏分享收藏分享收藏分享收藏The Programmer’s Assistant: Conversational Interaction with a Large Language Model for Software Development程序员的助手: 与软件开发的大型语言模型进行会话交互OAAI
OAAI分享收藏
查看更多内容