返回
Semi-Supervised Anomaly Detection Algorithm Using Probabilistic Labeling (SAD-PL)
DOI:10.1109/ACCESS.2021.3120710.png)
摘要
En 中文
To detect abnormal data via semi-supervised learning, unlabeled data are generally assumed to be normal data. This assumption, however, causes inevitable performance degradation when a small fraction of abnormal data is included in the unlabeled dataset. To overcome the degradation and to maintain stable detection performance, we propose a semi-supervised anomaly detection algorithm using probabilistic labeling (SAD-PL) for unlabeled data. The proposed SAD-PL is composed of two steps: (1) estimating local outlier factor (LOF) scores of latent vectors from both labeled and unlabeled data and (2) estimating labeling probability on the unlabeled data by using the prior missing probability of the labeled data via the Neyman-Pearson (NP) criterion. The SAD-PL runs iteratively by using the proposed complementary learning functions until the rate of label changes is lower than the predefined threshold. Experimental results reveal that the SAD-PL shows superior detection probability over the existing algorithms and stable performance regardless of the normal to abnormal data ratio in unlabeled data and the ratio of change variation of unlabeled data statistics to labeled data statistics.
Keyword:
Labeling
Probabilistic logic
Anomaly detection
Training
Degradation
Licenses
Computational modeling
Anomaly detection
semi-supervised learning
probabilistic labeling
Neyman-Pearson criterion
local outlier factor
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Superstitious seasonality in precious metals markets? Evidence from GARCH models with time-varying skewness and kurtosis贵金属市场的迷信季节性?具有时变偏度和峰度的GARCH模型的证据

