arrow
Return

Deterministic attribute selection for isolation forest

delete2024-07-01
delete0
PRE
AI
Ł
Łukasz Gałka *
P
Paweł Karczmarek
DOI:10.1016/j.patcog.2024.110395delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Modern data mining techniques have been gained importance in recent years. In particular, anomaly detection algorithms, applied in key sectors of information technology, have been growing in popularity. One of the efficient and fast algorithms is Isolation Forest. The method consists of two separated stages: Forest formation and evaluation of elements. The first stage relies on forming a forest of isolation trees. Each tree is built in the same manner according to drawn samples and random divisions of data attributes. In this study, an innovative deterministic attribute selection method is proposed, maintaining its random value. New ideas based on imbalance, clustering, and a dispersion of values through non-linear transformation of elements are introduced and thoroughly analyzed. These novel anomaly detection approaches are applied to 25 real datasets, as well as our own artificially generated databases. The Area Under the ROC Curve and the Area Under the PR Curve are used as a measure of the outliers classification quality. The results of the numerical experiment have proven high efficiency and competitive evaluation speed of the proposals in comparison to other Isolation Forest-based approaches, as well as several other popular techniques.
Keywords:
Anomaly detection
Isolation forest
Outlier detection
Deterministic model

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

Lublin University of Technology cover
Lublin University of Technology
Scholars:
1.8K
Papers: 2.0K
Citations: 1.5K
Cited Papers

Cited Papers

Extended Isolation Forest
err2021-04-01
err190
errOAAI
errHariri, Sahand; Kind, Matias Carrasco; Brunner, Robert J.
errShare
errSave
Granular Models and Granular Outliers
err2018-12-01
err38
PREAI
errZhu, Xiubin; Pedrycz, Witold; Li, Zhiwu
errShare
errSave
Fuzzy C-Means-based Isolation Forest
err2021-07-01
err24
PREAI
errKarczmarek, Pawel; Kiersztyn, Adam; Pedrycz, Witold; Czerwinski, Dariusz
errShare
errSave
Deep Isolation Forest for Anomaly Detection
err2023-12-01
err78
errOAAI
errXu, Hongzuo; Pang, Guansong; Wang, Yijie; Wang, Yongjun
errShare
errSave
Isolation Forest Based on Minimal Spanning Tree
err2022-01-01
err12
errOAAI
errGalka, Lukasz; Karczmarek, Pawel; Tokovarov, Mikhail
errShare
errSave
researcher View more