arrow
Return

SeMalBERT: Semantic-based malware detection with bidirectional encoder representations from transformers

delete2024-02-01
delete10
PRE
AI
J
Junming Liu
Y
Yuntao Zhao *
Y
Yongxin Feng
Y
Yutao Hu
X
Xiangyu Ma
DOI:10.1016/j.jisa.2023.103690delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Machine learning models are widely used for identifying malicious software. However, existing models suffer from issues such as imprecise polysemous representations and a lack of contextual semantic representations, leading to the failure to recognize certain types of malicious software. In this paper, we propose a semantic-based intelligent malware detection model called SeMalBERT for identifying malicious software in Windows systems. Specifically, the model utilizes the API function sequences of malicious software as the learned features. Firstly, BERT is applied to accomplish word representation tasks and extract semantic information from the sequences. Secondly, a hybrid discriminator based on Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) is used to explore the chaining relationships between functions. Lastly, an external attention mechanism is added after the LSTM to enable the model to better focus on key information within the text. Experimental results demonstrate that SeMalBERT outperforms existing malware detection techniques in terms of accuracy, F1 score, and loss function value on a general dataset.
Keywords:
Cyber security
BERT
Malware
CNN
LSTM

Journal

Journal of Information Security and Applications cover
Journal of Information Security and Applications
IF:
3.7
Papers:
2.0K
Citations:
4.9K

Organization

S
Shenyang Ligong University
Scholars:
2.2K
Papers: 1.3K
Citations: 743
Cited Papers

Cited Papers

Detection of malware in downloaded files using various machine learning models
err2023-03-01
err5
errOAAI
errKamboj, Akshit; Kumar, Priyanshu; Bairwa, Amit Kumar; Joshi, Sandeep
errShare
errSave
errShare
errSave
IoMT Malware Detection Approaches: Analysis and Research Challenges
err2019-01-01
err83
errOAAI
errWazid, Mohammad; Das, Ashok Kumar; Rodrigues, Joel J. P. C.; Shetty, Sachin; Park, Youngho
errShare
errSave
OpCode-Level Function Call Graph Based Android Malware Classification Using Deep Learning
errSENSORS
IF3.5
err2020-06-29
err28
errOAAI
errNiu, Weina; Cao, Rong; Zhang, Xiaosong; Ding, Kangyi; Zhang, Kaimeng; Li, Ting
errShare
errSave
errShare
errSave
A Survey on Automated Dynamic Malware-Analysis Techniques and Tools
err2008-03-05
err557
PREAI
errEgele, Manuel; Scholte, Theodoor; Kirda, Engin; Kruegel, Christopher
errShare
errSave
A Deep Learning Approach With Deep Contextualized Word Representations for ChemicalProtein Interaction Extraction From Biomedical Literature
err2019-01-01
err18
errOAAI
errSun, Cong; Yang, Zhihao; Luo, Ling; Wang, Lei; Zhang, Yin; Lin, Hongfei; Wang, Jian
errShare
errSave
no more