arrow
Return

RADE: resource-efficient supervised anomaly detection using decision tree-based ensemble methods

delete2021-09-03
delete12
delete
OA
AI
S
Shay Vargaftik
I
Isaac Keslassy
A
Ariel Orda
Y
Yaniv Ben-Itzhak *
DOI:10.1007/s10994-021-06047-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The capability to perform anomaly detection in a resource-constrained setting, such as an edge device or a loaded server, is of increasing need due to emerging on-premises computation constraints as well as security, privacy and profitability reasons. Yet, the increasing size of datasets often results in current anomaly detection methods being too resource consuming, and in particular decision-tree based ensemble classifiers. To address this need, we present RADE-a new resource-efficient anomaly detection framework that augments standard decision-tree based ensemble classifiers to perform well in a resource constrained setting. The key idea behind RADE is first to train a small model that is sufficient to correctly classify the majority of the queries. Then, using only subsets of the training data, train expert models for these fewer harder cases where the small model is at high risk of making a classification mistake. We implement RADE as a scikit-learn classifier. Our evaluation indicates that RADE offers competitive anomaly detection capabilities as compared to standard methods while significantly improving memory footprint by up to 12x, training-time by up to 20x, and classification time by up to 16x.
Keywords:
Resource efficient machine learning
Fast machine learning
Anomaly detection
Supervised learning
Decision-tree based ensemble methods

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

V
vmware, inc.
Scholars:
70
Papers: 61
Citations: 0
T
Technion Israel Institute of Technology
Scholars:
1.6W
Papers: 1.5W
Citations: 2.0W
Cited Papers

Cited Papers

Azimilide Inhibits Multiple Cardiac Potassium Currents in Human Atrial Myocytes
err2002-12-01
err0
errOAAI
errFuhua Chen; Fardad Esmailian; Wei Sun; Glenn T. Wetzel; Jonnalagedda S. M. Sarma; Bramah N. Singh; Thomas S. Klitzner
errShare
errSave
Subcooling methods for CO2 refrigeration cycles: A review
err2018-09-01
err0
errOAAI
errRodrigo Llopis; Laura Nebot-Andrés; Daniel Sánchez; Jesús Catalán-Gil; Ramón Cabello
errShare
errSave
Dataset from the zero-energy log house project
err2020-12-01
err0
errOAAI
errAntti Kosonen; Anna Keskisaari
errShare
errSave
Crushed limestone as an aggregate in concrete production: the Cyprus case
err2010-03-29
err0
PREAI
errI. Ioannou; M. F. Petrou; R. Fournari; A. Andreou; C. Hadjigeorgiou; B. Tsikouras; K. Hatzipanagiotou
errShare
errSave
Understanding the biological basis of psychiatric disease: What’s next?
errCell
IF0
err2022-01-01
err0
errOAAI
errConor Liston; Angela Roberts; Kafui Dzirasa; Dan Geschwind; Susanne E. Ahmari; Christian Lüscher
errShare
errSave
A Survey of Random Forest Based Methods for Intrusion Detection Systems
err2018-05-23
err206
PREAI
errAlves Resende, Paulo Angelo; Drummond, Andre Costa
errShare
errSave
researcher View more