arrow
返回

Feature selection approach using ensemble learning for network anomaly detection

delete2020-11-05
delete27
delete
OA
AI
M
Mohammad Kazim Hooshmand *
I
Ibrahim Gad
DOI:10.1049/trit.2020.0073delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Feature selection is essential for prioritising important attributes in data to improve prediction quality in machine learning algorithms. As different selection techniques identify different feature sets, relying on a single method may result in risky decisions. The authors propose an ensemble approach using union and quorum combination techniques with five primary individual selection methods which are analysis of variance, variance threshold, sequential backward search, recursive feature elimination, and least absolute selection and shrinkage operator. The proposed method reduces features in three rounds: (i) discard redundant features using pairwise correlation, (ii) individual methods select their own feature sets independently, and (iii) equalise individual feature sets. The equalised individual feature sets are combined using union and quorum techniques. Both the combined and individual sets are tested for network anomaly detection using random forest, decision tree, K-nearest neighbours, Gaussian Naive Bayes, and logistic regression classifiers. The experimental results on the UNSW-NB15 data set show that random forest with union and quorum feature sets yields 99 and 99.02% f1_score with minimum 6 and 12 features, respectively. The results on the NSL-KDD data set show that random forest with union and quorum gets 99.34 and 99.21% f1_score with a minimum of 28 and 18 features.
Keyword:
feature selection
decision trees
data mining
pattern classification
security of data
support vector machines
Bayes methods
feature extraction
regression analysis
random forests
machine learning algorithms
primary individual selection methods
recursive feature elimination
absolute selection
shrinkage operator
discard redundant features
individual methods
equalise individual feature sets
equalised individual feature sets
quorum techniques
network anomaly detection
random forest
quorum feature
feature selection approach
ensemble learning

期刊

CAAI Transactions on Intelligence Technology 封面图
CAAI Transactions on Intelligence Technology
IF:
7.3
论文数:
669
被引数:
2.4K

机构

M
Mangalore University
学者数:
881
论文数: 743
被引数: 806
引用论文

引用论文

SpHnf6, a transcription factor that executes multiple functions in sea urchin embryogenesis
err2004-09-01
err0
PREAI
errOchan Otim; Gabriele Amore; Takuya Minokawa; David R. McClay; Eric H. Davidson
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Chapter 2.8 Long-term simulations of photo-oxidants and particulate matter over Europe with emphasis on North Rhine-Westphalia
err2007-01-01
err0
PREAI
errM. Memmesheimer; S. Wurzler; E. Friese; H.J. Jakobs; H. Feldmann; A. Ebel; C. Kessler; J. Geiger; U. Hartmann; A. Brandt; U. Pfeffer; H.P. Dorn
err分享
err收藏
A comprehensive performance evaluation of the air quality model BOLCHEM to reproduce the ozone concentrations over Italy
err2008-02-01
err0
PREAI
errMihaela Mircea; Massimo D’Isidoro; Alberto Maurizi; Lina Vitali; Fabio Monforti; Gabriele Zanini; Francesco Tampieri
err分享
err收藏
Emulation of a complex global aerosol model to quantify sensitivity to uncertain parameters
err
IF0
err2011-07-19
err0
errOAAI
errL. A. Lee; K. S. Carslaw; K. Pringle; G. W. Mann; D. V. Spracklen
err分享
err收藏
学者 查看更多内容