arrow
Return

Benchmarking Static Analysis Tools for Web Security

delete2018-09-01
delete41
PRE
AI
P
Paulo Nunes *
I
Ibéria Medeiros
J
José Fonseca
N
Nuno Neves
M
Miguel Correia
M
Marco Vieira
DOI:10.1109/TR.2018.2839339delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Static analysis tools are recurrently used by developers to search for vulnerabilities in the source code of web applications. However, distinct tools provide different results depending on factors such as the complexity of the code under analysis and the application scenario; thus, missing some of the vulnerabilities while reporting false problems. Benchmarks can be used to assess and compare different systems or components, however, existing benchmarks have strong representativeness limitations, disregarding the specificities of the environment, where the tools under benchmarking will be used. In this paper, we propose a benchmark for assessing and comparing static analysis tools in terms of their capability to detect security vulnerabilities. The benchmark considers four real-world development scenarios, including workloads composed of real web applications with different goals and constraints, ranging from low budget to high-end applications. Our benchmark was implemented and assessed experimentally using a set of 134 Word Press plugins, which served as the basis for the evaluation of five free PHP static analysis tools. Results clearly show that the best solution depends on the deployment scenario and class of vulnerability being detected; therefore, highlighting the importance of these aspects in the design of the benchmark and of future static analysis tools.
Keywords:
Benchmarking
security metrics
static analysis tools (SATs)
vulnerability detection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Reliability cover
IEEE Transactions on Reliability
IF:
5.7
Papers:
2.7K
Citations:
8.5K

Organization

U
universidade de lisboa
Scholars:
3.4W
Papers: 3.1W
Citations: 29
I
instituto politecnico da guarda
Scholars:
134
Papers: 114
Citations: 0
I
inesc-id
Scholars:
636
Papers: 504
Citations: 0
researcher View more organizations