arrow
Return

RADE: resource-efficient supervised anomaly detection using decision tree-based ensemble methods

delete2021-09-03
delete12
delete
OA
AI
S
Shay Vargaftik
I
Isaac Keslassy
A
Ariel Orda
Y
Yaniv Ben-Itzhak *
DOI:10.1007/s10994-021-06047-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The capability to perform anomaly detection in a resource-constrained setting, such as an edge device or a loaded server, is of increasing need due to emerging on-premises computation constraints as well as security, privacy and profitability reasons. Yet, the increasing size of datasets often results in current anomaly detection methods being too resource consuming, and in particular decision-tree based ensemble classifiers. To address this need, we present RADE-a new resource-efficient anomaly detection framework that augments standard decision-tree based ensemble classifiers to perform well in a resource constrained setting. The key idea behind RADE is first to train a small model that is sufficient to correctly classify the majority of the queries. Then, using only subsets of the training data, train expert models for these fewer harder cases where the small model is at high risk of making a classification mistake. We implement RADE as a scikit-learn classifier. Our evaluation indicates that RADE offers competitive anomaly detection capabilities as compared to standard methods while significantly improving memory footprint by up to 12x, training-time by up to 20x, and classification time by up to 16x.
Keywords:
Resource efficient machine learning
Fast machine learning
Anomaly detection
Supervised learning
Decision-tree based ensemble methods

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

V
vmware, inc.
Scholars:
70
Papers: 61
Citations: 0
T
Technion Israel Institute of Technology
Scholars:
1.6W
Papers: 1.5W
Citations: 2.0W