arrow
Return

Efficient Anomaly Detection for High-Dimensional Sensing Data With One-Class Support Vector Machine

delete2023-01-01
delete17
PRE
AI
Y
Yan Qiao *
K
Kui Wu
P
Peng Jin
DOI:10.1109/TKDE.2021.3077046delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper addresses the problem of anomaly detection for high-dimensional sensing data. The one-class support vector machine (OCSVM) is one of the most popular unsupervised methods for anomaly detection. When data are high dimensional and large scale, however, the efficiency of OCSVM-based methods in anomaly detection suffers. Although dimensionality-reduction tools, such as deep belief networks, can be applied to compress the high-dimensional data to alleviate the problem, the accuracy and timely detection are still hard to improve due to the inherent features of OCSVM. In this paper, we propose a new form of OCSVM model based on the structure of the compressed data and the characteristics of OCSVM. Based on the new model, we design both optimal and approximate methods for model training and testing. We evaluate the performance of our methods with extensive experiments on four real-world datasets. The experimental results demonstrate that our new methods, both optimal and approximate ones, not only significantly outperform the state-of-the-art in accuracy and efficiency, but also achieve the good performance without the need of manual parameter tuning. In addition, our approximate training and testing mechanism can reduce the computing time by three orders of magnitude with a negligible loss in accuracy.
Keywords:
Internet of Things
anomaly detection
high-dimensional data
deep belief network
one-class support vector machines
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

A
Anhui Agricultural University
Scholars:
1.2W
Papers: 5.7K
Citations: 1.0W
H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
U
University of Victoria
Scholars:
1.0W
Papers: 1.0W
Citations: 1.5W
researcher View more organizations
Cited Papers

Cited Papers

Automated clarity assessment of retinal images using regionally based structural and statistical measures
err2012-09-01
err0
PREAI
errAlan D. Fleming; Sam Philip; Keith A. Goatman; Peter F. Sharp; John A. Olson
errShare
errSave
Assessment of doped ceria as electrolyte
err2006-05-13
err0
PREAI
errBjarke Dalslet; Peter Blennow; Peter Vang Hendriksen; Nikolaos Bonanos; Dorthe Lybye; Mogens Mogensen
errShare
errSave
errShare
errSave
CLAPP: A self constructing feature clustering approach for anomaly detection
err2017-09-01
err47
PREAI
errKumar, Gunupudi Rajesh; Mangathayaru, Nimmala; Narsimha, Gugulothu; Reddy, Gali Suresh
errShare
errSave
A CNN-BASED RETINAL IMAGE QUALITY ASSESSMENT SYSTEM FOR TELEOPHTHALMOLOGY
err2019-09-03
err0
PREAI
errXUEWEI WANG; SHULIN ZHANG; XIAO LIANG; CHUN ZHENG; JINJIN ZHENG; MINGZHAI Sun
errShare
errSave
Sensitive detection of metals in water using laser-induced breakdown spectroscopy on wood sample substrates
err2010-03-09
err0
PREAI
errZhijiang Chen; Yogesh Godwal; Ying Yin Tsui; Robert Fedosejevs
errShare
errSave
researcher View more