arrow
Return

A soft actor-critic reinforcement learning algorithm for network intrusion detection

delete2023-12-01
delete3
PRE
AI
Z
Zhengfa Li
C
Chuanhe Huang *
S
Shuhua Deng
邱晚玉 cover
邱晚玉 (Wanyu Qiu)
X
Xieping Gao
DOI:10.1016/j.cose.2023.103502delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Network intrusion detection plays a very important role in network security. Although current deep learning-based intrusion detection algorithms have achieved good detection performance, there are still limitations in dealing with unbalanced datasets and identifying minority attacks and unknown attacks. In this paper, we propose an intrusion detection model AE-SAC based on adversarial environment learning and soft actor-critic reinforcement learning algorithm. First, this paper introduces an environmental agent for training data resampling to solve the imbalance problem of the original data. Second, rewards are redefined in reinforcement learning. In order to improve the recognition rate of few categories of network attacks, we set different reward values for different categories of attacks. The environment agent and classifier agent are trained adversarially around maximizing their respective reward values. Finally, a multi-classification experiment is conducted on the NSL-KDD and AWID datasets to compare with the existed excellent intrusion detection algorithms. AE-SAC achieves excellent classification performance with an accuracy of 84.15% and a f1-score of 83.97% on the NSL-KDD dataset, and an accuracy and a f1-score over 98.9% on the AWID dataset.
Keywords:
Network security
Anomaly detection
Network intrusion detection
Deep reinforcement learning
Soft actor-critic

Journal

C
Computers and Security
IF:
5.4
Papers:
4.6K
Citations:
1.4W

Organization

H
Hunan Normal University
Scholars:
1.3W
Papers: 8.2K
Citations: 9.1K
W
wuhan university
Scholars:
8.1W
Papers: 5.8W
Citations: 70
Cited Papers

Cited Papers

errShare
errSave
Modeling by artificial neural networks of silver carp (Hypophthalmichthys molitrixi) with sous vide processing on the effects of storage and processing temperatures on the microbiological status
err
IF0
err2021-01-26
err0
errOAAI
errSeyed Vali Hosseini; Milad Pero; Reza Tahergorabi; Shirin Kazemzadeh; Ricardo Santos Alemán; Jhunior Abrahan Marcia Fuentes; Ismael Montero Fernández; Lilian Sosa; Xesus Feas Sanchez
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Intrusion Detection in 802.11 Networks: Empirical Evaluation of Threats and a Public Dataset
err2016-01-01
err344
PREAI
errKolias, Constantinos; Kambourakis, Georgios; Stavrou, Angelos; Gritzalis, Stefanos
errShare
errSave
errShare
errSave
Deep Learning Approach for Intelligent Intrusion Detection System
err2019-01-01
err868
errOAAI
errVinayakumar, R.; Alazab, Mamoun; Soman, K. P.; Poornachandran, Prabaharan; Al-Nemrat, Ameer; Venkatraman, Sitalakshmi
errShare
errSave
BAT: Deep Learning Methods on Network Intrusion Detection Using NSL-KDD Dataset
err2020-01-01
err247
errOAAI
errSu, Tongtong; Sun, Huazhi; Zhu, Jinqi; Wang, Sheng; Li, Yabo
errShare
errSave
researcher View more