arrow
返回

Evaluating algorithms for anomaly detection in satellite telemetry data

delete2022-09-01
delete18
PRE
AI
J
Jakub Nalepa *
M
Michał Myller
J
Jacek Andrzejewski
P
Paweł Benecki
S
Szymon Piechaczek
D
Daniel Kostrzewa
DOI:10.1016/j.actaastro.2022.06.026delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Detecting anomalies in telemetry data captured on-board a spacecraft is critical to ensure its safe operation. Although there exist various techniques for automatically detecting point, contextual, and collective anomalies from time-series data, quantifying their performance remains under-researched. In this paper, we thoroughly validate our approach for the task of anomalous event detection that is built upon a two-stage technique, in which the telemetry signal is predicted using a long short-term memory network based on the historical data, and then the prediction is compared with the actual (captured) data. If the difference between those two is sufficiently large, we can infer that an anomalous event has happened. To evaluate the capabilities of such detection techniques over the simulated and benchmark time-series data, we investigate a set of commonly used metrics obtained for a range of anomaly detection approaches, and present their shortcomings, especially related to their inability of capturing the temporal aspects of the detectors. We tackle this issue by introducing new quality metrics which enable us to objectively verify if the detectors can timely spot the anomalies in sequential data. The experimental study showed that inferring the conclusions based on a subset of metrics can lead to biased observations, as the best algorithms determined based on the overlap metrics, including the Dice coefficient, do not necessarily correspond to the algorithms that offer the fastest detection. Finally, we discuss the Antelope Toolbox???our software tool for simulating nominal telemetry data of given characteristics, alongside well-defined anomalous events, and to perform the quantitative and qualitative analysis of anomaly detection algorithms over such simulated events.
Keyword:
Deeplearning
Recurrentneuralnetwork
LSTM
Anomalydetection
Quantitativeandqualitativeanalysis
Evaluation

期刊

Acta Astronautica 封面图
Acta Astronautica
IF:
3.4
论文数:
1.2W
被引数:
2.1W

机构

S
Silesian University of Technology
学者数:
6.2K
论文数: 6.2K
被引数: 5.9K
引用论文

引用论文

Anomaly Detection and Classification in Multispectral Time Series Based on Hidden Markov Models
err2022-01-01
err18
errOAAI
errLeon-Lopez, Kareth M.; Mouret, Florian; Arguello, Henry; Tourneret, Jean-Yves
err分享
err收藏
Clinicopathologic Comparison of Plasmablastic Lymphoma in HIV-positive, Immunocompetent, and Posttransplant Patients
err2014-07-01
err0
PREAI
errJulie Morscio; Daan Dierickx; Jan Nijs; Gregor Verhoef; Emilie Bittoun; Xanne Vanoeteren; Iwona Wlodarska; Xavier Sagaert; Thomas Tousseyn
err分享
err收藏
err分享
err收藏
err分享
err收藏
Do Accounting Standards Matter for Productivity?
err2021-01-01
err0
PREAI
errRajiv Banker; Rong Huang; Yinghua Li; Sha Zhao
err分享
err收藏
Using volcaniclastic rocks to constrain sedimentation ages: To what extent are volcanism and sedimentation synchronous?
err2019-03-01
err0
errOAAI
errCamille Rossignol; Erwan Hallot; Sylvie Bourquin; Marc Poujol; Marc Jolivet; Pierre Pellenard; Céline Ducassou; Thierry Nalpas; Gloria Heilbronn; Jianxin Yu; Marie-Pierre Dabard
err分享
err收藏
学者 查看更多内容