.png){kind=icon}
.png){kind=icon}
Return
Benchmarking static code analyzers
.png){kind=icon}
PRE
AI
DOI：10.1016/j.ress.2019.03.031.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We show that a widely used benchmark set for the comparison of static = analysis tools exhibits an impressive number of weaknesses, and that the internationally accepted quantitative = evaluation metrics may lead to useless results. The weaknesses in the benchmark set were identified by applying a sound static analysis to the programs in this set and carefully interpreting the results. We propose how to deal with weaknesses of the quantitative metrics and how to improve such benchmarks and the evaluation process, in particular for external evaluations, in which an ideally neutral institution does the evaluation, whose results potential clients can trust. We also show that sufficiently high quality of the test cases makes an automatic result evaluation possible.
Keywords:
Static code analysis
Sound semantic analysis
C code
Safety-critical code
Benchmarking
Test case design
Abstract interpretation
Functional safety
Tool evaluation
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
R
IF:
11
Papers:
9.0K
Citations:
4.2W