.png){kind=icon}
返回
Investigating large language models capabilities for automatic code repair in Python
.png){kind=icon}
PRE
AI
DOI：10.1007/s10586-024-04490-8.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Developers often encounter challenges with their introductory programming tasks as part of the development process. Unfortunately, rectifying these mistakes manually can be time-consuming and demanding. Automated program repair (APR) techniques offer a potential solution by synthesizing fixes for such errors. Previous research has investigated the utilization of both symbolic and neural techniques within the APR domain. However, these approaches typically demand significant engineering efforts or extensive datasets and training. In this paper, we explore the potential of using a large language model trained on code, specifically, we assess ChatGPT's capability to detect and repair bugs in simple Python programs. The experimental evaluation encompasses two benchmarks: QuixBugs and Textbook. Each benchmark consists of simple Python functions that implement well-known algorithms and each function contains a single bug. To gauge repair performance in various settings, several benchmark variations were introduced including addition of plain English documentation and code obfuscation. Based on thorough experiments, we found that ChatGPT was able to correctly detect and fix about 50% of the methods, when code is documented. Repair performance drops to 25% when code is obfuscated, and 15% when documentation is removed and code is obfuscated. Furthermore, when compared to existing APR systems, ChatGPT considerably outperformed them.
Keyword:
Automatic program repair
Large language models
Python
Bug detection
期刊
C
IF:
4.1
论文数:
5.1K
被引数:
7.5K
机构
引用论文
.png){kind=icon}
An Empirical Study on Learning Bug-Fixing Patches in the Wild via Neural Machine Translation通过神经机器翻译在野外学习错误修复补丁的实证研究
OAAI
OAAI分享收藏Pre-Trained Model-Based Automated Software Vulnerability Repair: How Far are We?基于预训练模型的自动化软件漏洞修复: 我们还有多远？
OAAI
OAAI分享收藏
查看更多内容