返回
MalBERTv2: Code Aware BERT-Based Model for Malware Identification
DOI:10.3390/bdcc7020060.png)
摘要
En 中文
To proactively mitigate malware threats, cybersecurity tools, such as anti-virus and anti-malware software, as well as firewalls, require frequent updates and proactive implementation. However, processing the vast amounts of dataset examples can be overwhelming when relying solely on traditional methods. In cybersecurity workflows, recent advances in natural language processing (NLP) models can aid in proactively detecting various threats. In this paper, we present a novel approach for representing the relevance and significance of the Malware/Goodware (MG) datasets, through the use of a pre-trained language model called MalBERTv2. Our model is trained on publicly available datasets, with a focus on the source code of the apps by extracting the top-ranked files that present the most relevant information. These files are then passed through a pre-tokenization feature generator, and the resulting keywords are used to train the tokenizer from scratch. Finally, we apply a classifier using bidirectional encoder representations from transformers (BERT) as a layer within the model pipeline. The performance of our model is evaluated on different datasets, achieving a weighted f1 score ranging from 82% to 99%. Our results demonstrate the effectiveness of our approach for proactively detecting malware threats using NLP techniques.
Keyword:
malware detection
natural language processing
transformer-based model
期刊
B
IF:
4.4
论文数:
1.3K
被引数:
2.4K
机构
引用论文
Is the temperament of crossbred dairy cows related to milk cortisol and oxytocin concentrations, milk yield, and quality?杂交奶牛的 temperament 是否与牛奶中的皮质醇和催产素浓度、产奶量及奶质有关?
PLOS ONE
IF0

