arrow
Return

Patch Correctness Assessment: A Survey

delete2025-01-20
delete0
delete
OA
AI
Z
Zhiwei Fei *
葛
葛季栋 (Jidong Ge)
李
李传艺 (Chuanyi Li)
T
Tianqi Wang
Y
Y. Li
H
H. Zhang
L
LiGuo Huang
B
Bin Luo
DOI:10.1145/3702972delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most automated program repair methods rely on test cases to determine the correctness of the generated patches. However, due to the incompleteness of available test suites, some patches that pass all the test cases may still be incorrect. This issue is known as the patch overfitting problem. Overfitting problem is a longstanding problem in automated program repair. Due to overfitting patches, the patches obtained by automated program repair tools require further validation to determine their correctness. Researchers have proposed many methods to automatically assess the correctness of patches, but no systematic review provides a detailed introduction to this problem, the existing solutions, and the challenges. To address this deficiency, we systematically review the existing approaches to patch correctness assessment. We first offer a few examples of overfitting patches to acquire a more detailed understanding of this problem. We then propose a comprehensive categorization of publicly available techniques and datasets, examine the commonly used evaluation metrics, and perform an in-depth analysis of the effectiveness of the existing models in addressing the challenge of overfitting. Based on our analysis, we provided the difficulties encountered by current methodologies, alongside the possible avenues for future research exploration.
Keywords:
Automated Program Repair
Patch Correctness Assessment
Patch Overfitting Problem

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

N
nanjing university
Scholars:
7.8W
Papers: 5.6W
Citations: 87
S
Southern Methodist University
Scholars:
3.0K
Papers: 3.5K
Citations: 3.9K
Cited Papers

Cited Papers

errShare
errSave
Ebola virus sequencing protocol v1
err
IF0
err2019-09-25
err0
errOAAI
errJosh Quick
errShare
errSave
Tension pneumoperitoneum after heart-lung transplantation
err1994-02-01
err0
errOAAI
errRoderich E. Schwarz; Si M. Pham; Morris I. Bierman; Kenneth W. Lee; Bartley P. Griffith
errShare
errSave
A critical review on the evaluation of automated program repair systems
err2021-01-01
err52
errOAAI
errLiu, Kui; Li, Li; Koyuncu, Anil; Kim, Dongsun; Liu, Zhe; Klein, Jacques; Bissyande, Tegawende F.
errShare
errSave
Automated Classification of Overfitting Patches With Statically Extracted Code Features
err2022-08-01
err41
errOAAI
errYe, He; Gu, Jian; Martinez, Matias; Durieux, Thomas; Monperrus, Martin
errShare
errSave
On the Naturalness of Software
err2016-04-26
err164
PREAI
errHindle, Abram; Barr, Earl T.; Gabel, Mark; Su, Zhendong; Devanbu, Premkumar
errShare
errSave
SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repair
err2021-01-01
err217
errOAAI
errChen, Zimin; Kommrusch, Steve; Tufano, Michele; Pouchet, Louis-Noel; Poshyvanyk, Denys; Monperrus, Martin
errShare
errSave
researcher View more