arrow
返回

Evaluating C/C plus plus Vulnerability Detectability of Query-Based Static Application Security Testing Tools

delete2024-09-01
delete0
PRE
AI
Z
Zongjie Li
Z
Zhibo Liu
W
Wai Kin Wong
P
Pingchuan Ma
S
Shuai Wang *
DOI:10.1109/TDSC.2024.3354789delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, query-based static application security testing(Q-SAST) tools such as CodeQL have gained popularity due to their ability to codify vulnerability knowledge into SQL-like queries and search for vulnerabilities in the database derived from the software. The industry has made considerable progress in building Q-SAST tools, facilitating their integration into the continuous integration (CI) pipeline, and sustaining an active community. However, we do not have a systematic understanding of their vulnerability detection capability in comparison to conventional SAST tools. We conduct the first in-depth study of Q-SAST to demystify their C/C++ vulnerability detectability. Our study is conducted from three complementary aspects. We first use a synthetic CWE test suite and a real-world CVE test suite, totaling almost 30 K programs with known CWE/CVE, to assess popular (commercial) Q-SAST and industry-leading SAST (requiring no queries). Then, we gather defect-fixing pull requests (PRs) since the release dates of three popular Q-SAST tools, characterizing historically-fixed defects and comparing them to pitfalls exposed in our CWE/CVE study. To enhance vulnerability detection, we design SAST-MT, a metamorphic testing framework to detect false positives (FPs) and false negatives (FNs) of Q-SAST. Findings of SAST-MT can be used to easily expose the root causes of Q-SAST's FPs and FNs. We summarize lessons from our study that can benefit both users and developers of Q-SAST.
Keyword:
Software
Databases
Security
Computer bugs
Codes
Testing
Software development management
SAST
static analysis
vulnerability detection

期刊

IEEE Transactions on Dependable and Secure Computing 封面图
IEEE Transactions on Dependable and Secure Computing
IF:
7.5
论文数:
2.5K
被引数:
9.6K

机构

暂无机构信息
引用论文

引用论文

Prevalence study of epilepsy in Malaysia
err2021-02-01
err0
PREAI
errSi-Lei Fong; Kheng-Seang Lim; LeeAnn Tan; Nabilah Hanis Zainuddin; Jun-Hui Ho; Zhi-Jien Chia; Wan-Yuen Choo; Santhi Datuk Puvanarajah; Suganthi Chinnasami; Sow-Kuan Tee; Azman Ali Raymond; Wan-Chung Law; Chong-Tin Tan
err分享
err收藏
Limited utility of structural MRI to identify the epileptogenic zone in young children with tuberous sclerosis
err2022-06-21
err0
PREAI
errMaaike Nijman; Edward Yang; Camilo Jaimes; Anna K. Prohl; Mustafa Sahin; Darcy A. Krueger; Joyce Y. Wu; Hope Northrup; Scellig S.D. Stone; Joseph R. Madsen; Aria Fallah; Jeffrey P. Blount; Howard L. Weiner; Leslie Grayson; E. Martina Bebin; Brenda E. Porter; Simon K. Warfield; Sanjay P. Prabhu; Jurriaan M. Peters
err分享
err收藏
Editorial: Neurotransmitters and Emotions
err2020-01-29
err0
errOAAI
errFushun Wang; Jiongjiong Yang; Fang Pan; Roger C. Ho; Jason H. Huang
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容