arrow
Return

Mokav: Execution-driven differential testing with LLMs

delete2025-07-19
delete0
delete
OA
AI
K
Khashayar Etemadi
B
Bardia Mohammadi
Z
Zhendong Su
M
Martin Monperrus
DOI:10.1016/j.jss.2025.112571delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• Mokav is the first LLM-based tool for difference exposing test generation • C4DET is a curated dataset of 1,535 pair of programs with small semantic differences. • The iterative execution-driven approach of Mokav outperforms state-of-the-art in differential testing • An example test that guides the LLM about input structure significantly improves the effectiveness.
Keywords:
Test generation
Large language models
Behavioral difference

Journal

Journal of Systems and Software cover
Journal of Systems and Software
IF:
4.1
Papers:
5.5K
Citations:
8.4K

Organization

K
KTH Royal Institute of Technology
Scholars:
1.3K
Papers: 777
Citations: 2.6W
S
Sharif University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 9.5K
E
ETH Zurich
Scholars:
3.0W
Papers: 2.4W
Citations: 8.4W
researcher View more organizations
Cited Papers

Cited Papers

Fuzz4All: Universal Fuzzing with Large Language Models
err2024-04-12
err0
errOAAI
errChunqiu Steven Xia; Matteo Paltenghi; Jia Le Tian; Michael Pradel; Lingming Zhang
errShare
errSave
Augmenting Diffs With Runtime Information
err
IF0
err2023-11-01
err0
PREAI
errKhashayar Etemadi; Aman Sharma; Fernanda Madeiral; Martin Monperrus
errShare
errSave
TOGA
err2022-07-05
err0
errOAAI
errElizabeth Dinella; Gabriel Ryan; Todd Mytkowicz; Shuvendu K. Lahiri
errShare
errSave
Container-based Sandboxes for Malware Analysis
err2019-12-02
err0
PREAI
errAyrat Khalimov; Sofiane Benahmed; Rasheed Hussain; S.M. Ahsan Kazmi; Alma Oracevic; Fatima Hussain; Farhan Ahmad; Chaker Abdelaziz Kerrache
errShare
errSave
Demo: Discovering Faulty Patches in Robotic Vehicle Control Software
err
IF0
err2023-01-01
err0
PREAI
errHyungsub Kim; Muslum Ozgur Ozmen; Z. Berkay Celik; Antonio Bianchi; Dongyan Xu
errShare
errSave
A Generative and Mutational Approach for Synthesizing Bug-Exposing Test Cases to Guide Compiler Fuzzing
err
IF0
err2023-11-30
err0
PREAI
errGuixin Ye; Tianmin Hu; Zhanyong Tang; Zhenye Fan; Shin Hwei Tan; Bo Zhang; Wenxiang Qian; Zheng Wang
errShare
errSave
Search-based detection of deviation failures in the migration of legacy spreadsheet applications
err
IF0
err2018-07-12
err0
PREAI
errM. Moein Almasi; Hadi Hemmati; Gordon Fraser; Phil McMinn; Janis Benefelds
errShare
errSave
A systematic literature review of techniques and metrics to reduce the cost of mutation testing
err2019-11-01
err73
PREAI
errPizzoleto, Alessandro Viola; Ferrari, Fabiano Cutigi; Offutt, Jeff; Fernandes, Leo; Ribeiro, Marcio
errShare
errSave
researcher View more