Applying Big Data Based Deep Learning System to Intrusion Detection

Wei Zhong

doi:10.26599/BDMA.2020.9020003

Applying Big Data Based Deep Learning System to Intrusion Detection

2020-09-01

88

OA

AI

DOI：10.26599/BDMA.2020.9020003

原文链接

查看原文

摘要

En 中文

With vast amounts of data being generated daily and the ever increasing interconnectivity of the world's internet infrastructures, a machine learning based Intrusion Detection Systems (IDS) has become a vital component to protect our economic and national security. Previous shallow learning and deep learning strategies adopt the single learning model approach for intrusion detection. The single learning model approach may experience problems to understand increasingly complicated data distribution of intrusion patterns. Particularly, the single deep learning model may not be effective to capture unique patterns from intrusive attacks having a small number of samples. In order to further enhance the performance of machine learning based IDS, we propose the Big Data based Hierarchical Deep Learning System (BDHDLS). BDHDLS utilizes behavioral features and content features to understand both network traffic characteristics and information stored in the payload. Each deep learning model in the BDHDLS concentrates its efforts to learn the unique data distribution in one cluster. This strategy can increase the detection rate of intrusive attacks as compared to the previous single learning model approaches. Based on parallel training strategy and big data techniques, the model construction time of BDHDLS is reduced substantially when multiple machines are deployed.

Keyword:

intrusion detection

deep learning

convolution neural network

fully connected feedforward neural network

multi-level clustering algorithm

Applying Big Data Based Deep Learning System to Intrusion Detection

摘要

AI总结

期刊

机构

引用论文