arrow
Return

Patch Correctness Assessment: A Survey

delete2025-01-20
delete0
delete
OA
AI
Z
Zhiwei Fei *
葛季栋 (Jidong Ge)
李传艺 (Chuanyi Li)
T
Tianqi Wang
Y
Y. Li
H
H. Zhang
L
LiGuo Huang
B
Bin Luo
DOI:10.1145/3702972delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most automated program repair methods rely on test cases to determine the correctness of the generated patches. However, due to the incompleteness of available test suites, some patches that pass all the test cases may still be incorrect. This issue is known as the patch overfitting problem. Overfitting problem is a longstanding problem in automated program repair. Due to overfitting patches, the patches obtained by automated program repair tools require further validation to determine their correctness. Researchers have proposed many methods to automatically assess the correctness of patches, but no systematic review provides a detailed introduction to this problem, the existing solutions, and the challenges. To address this deficiency, we systematically review the existing approaches to patch correctness assessment. We first offer a few examples of overfitting patches to acquire a more detailed understanding of this problem. We then propose a comprehensive categorization of publicly available techniques and datasets, examine the commonly used evaluation metrics, and perform an in-depth analysis of the effectiveness of the existing models in addressing the challenge of overfitting. Based on our analysis, we provided the difficulties encountered by current methodologies, alongside the possible avenues for future research exploration.
Keywords:
Automated Program Repair
Patch Correctness Assessment
Patch Overfitting Problem

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

N
nanjing university
Scholars:
7.7W
Papers: 5.6W
Citations: 87
S
Southern Methodist University
Scholars:
3.0K
Papers: 3.5K
Citations: 3.9K