.png){kind=icon}
Return
MalBERTv2: Code Aware BERT-Based Model for Malware Identification
.png){kind=icon}
OA
AI
DOI：10.3390/bdcc7020060.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
To proactively mitigate malware threats, cybersecurity tools, such as anti-virus and anti-malware software, as well as firewalls, require frequent updates and proactive implementation. However, processing the vast amounts of dataset examples can be overwhelming when relying solely on traditional methods. In cybersecurity workflows, recent advances in natural language processing (NLP) models can aid in proactively detecting various threats. In this paper, we present a novel approach for representing the relevance and significance of the Malware/Goodware (MG) datasets, through the use of a pre-trained language model called MalBERTv2. Our model is trained on publicly available datasets, with a focus on the source code of the apps by extracting the top-ranked files that present the most relevant information. These files are then passed through a pre-tokenization feature generator, and the resulting keywords are used to train the tokenizer from scratch. Finally, we apply a classifier using bidirectional encoder representations from transformers (BERT) as a layer within the model pipeline. The performance of our model is evaluated on different datasets, achieving a weighted f1 score ranging from 82% to 99%. Our results demonstrate the effectiveness of our approach for proactively detecting malware threats using NLP techniques.
Keywords:
malware detection
natural language processing
transformer-based model
Journal
B
IF:
4.4
Papers:
1.3K
Citations:
2.4K
Organization
Cited Papers
Static malware detection and attribution in android byte-code through an end-to-end deep system
PREAI
ShareSaveIs the temperament of crossbred dairy cows related to milk cortisol and oxytocin concentrations, milk yield, and quality?.png)
PLOS ONEOAAI
PLOS ONEIF0
OAAIShareSaveShareSaveShareSave
View more