arrow
返回

Python source code vulnerability detection with named entity recognition

delete2024-05-01
delete4
PRE
AI
M
M. Ehrenberg *
S
Shahram Sarkani
T
Thomas A. Mazzuchi
DOI:10.1016/j.cose.2024.103802delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Vulnerabilities within source code have grown over the last 20 years to become a common threat to systems and networks. As the implementation of open -source software continues to develop, more unknown vulnerabilities will exist throughout system networks. This research proposes an enhanced vulnerability detection method specific to Python source code that utilizes pre-trained, BERT -based transformer models to apply tokenization, embedding, and named entity recognition (a natural language processing technique). The use of named entity recognition not only allows for the detection of potential vulnerabilities, but also for the classification of different vulnerability types. This research uses the publicly available CodeBERT, RoBERTa, and DistilBERT models to fine -tune for the downstream task of token classification for six different common weakness enumeration specifications. The results achieved in this research outperform previous Python-based vulnerability detection methods and demonstrate the effectiveness of applying named entity recognition to enhance the overall research into Python source code vulnerabilities.
Keyword:
Vulnerability detection
Natural language processing
Machine learning
Named entity recognition
Transformer
Python
BERT
Programming language
Common weakness enumeration
CWE

期刊

C
Computers and Security
IF:
5.4
论文数:
4.6K
被引数:
1.4W

机构

G
George Washington University
学者数:
1.6W
论文数: 1.4W
被引数: 1.7W
引用论文

引用论文

Vulnerability detection through cross-modal feature enhancement and fusion
err2023-09-01
err4
PREAI
errTao, Wenxin; Su, Xiaohong; Wan, Jiayuan; Wei, Hongwei; Zheng, Weining
err分享
err收藏
VUDENC: Vulnerability Detection with Deep Learning on a Natural Codebase for Python
err2022-04-01
err57
errOAAI
errWartschinski, Laura; Noller, Yannic; Vogel, Thomas; Kehrer, Timo; Grunske, Lars
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Predicting Vulnerable Software Components via Text Mining
err2014-10-01
err266
errOAAI
errScandariato, Riccardo; Walden, James; Hovsepyan, Aram; Joosen, Wouter
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容