arrow
返回

Efficient KPI Anomaly Detection Through Transfer Learning for Large-Scale Web Services

delete2022-08-01
delete17
PRE
AI
张圣麟 封面图
张圣麟 (Shenglin Zhang)
Z
Zhenyu Zhong
D
Dongwen Li
Q
Qiliang Fan
孙
孙永谦 (Yongqian Sun) *
祝曼 封面图
祝曼 (Man Zhu)
Y
Yuzhi Zhang
裴
裴丹 (Dan Pei)
J
Jiyan Sun
Y
Yinlong Liu
H
Hui Yang
Y
Yongqiang Zou
DOI:10.1109/JSAC.2022.3180785delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Timely anomaly detection of key performance indicators (KPIs), e.g., service response time, error rate, is of utmost importance to Web services. Over the years, many unsupervised deep learning-based anomaly detection approaches have been proposed. To achieve good performance, they require a long period of KPI data for model training, which is not easy to guarantee with frequent service changes. Additionally, the training overhead is too significant for the vast number of KPIs in large-scale Web services. To address the problems, we propose an unsupervised KPI anomaly detection approach, named AnoTransfer, by combining a novel Variational Auto-Encoder (VAE)-based KPI clustering algorithm with an adaptive transfer learning strategy. Extensive evaluation experiments using real-world data collected from several large-scale Web service providers demonstrate that AnoTransfer reduces the average initialization time by 65.71% and improves the training efficiency by 50.62 times, without significantly degrading anomaly detection accuracy.
Keyword:
Anomaly detection
Transfer learning
Key performance indicator
Training
Adaptation models
Shape
Sun
Key performance indicator
anomaly detection
time series clustering
transfer learning

期刊

IEEE Journal on Selected Areas in Communications 封面图
IEEE Journal on Selected Areas in Communications
IF:
17.2
论文数:
6.4K
被引数:
3.1W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
I
institute of information engineering, cas
学者数:
477
论文数: 469
被引数: 0
N
nankai university
学者数:
4.8W
论文数: 3.3W
被引数: 74
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Detecting Outlier Machine Instances Through Gaussian Mixture Variational Autoencoder With One Dimensional CNN
err2022-04-01
err21
PREAI
errSu, Ya; Zhao, Youjian; Sun, Ming; Zhang, Shenglin; Wen, Xidao; Zhang, Yongsu; Liu, Xian; Liu, Xiaozhou; Tang, Junliang; Wu, Wenfei; Pei, Dan
err分享
err收藏
Synergistic antiproliferative activity of tamoxifen and cisplatin on primary ovarian tumours
err1992-01-01
err0
PREAI
errGiovanni Scambia; Franco O Ranelletti; Pierluigi Benedetti Panici; Mauro Piantelli; Rosa De Vincenzo; Guiseppina Bonanno; Gabriella Ferrandina; Giulio Isola; Salvatore Mancuso
err分享
err收藏
Enhancement of 1,2-Dimethylhydrazine-Induced Rectal Carcinogenesis Following Chronic Ethanol Consumption in the Rat
err1984-05-01
err0
PREAI
errH.K. SEITZ; P. CZYGAN; R. WALDHERR; S. VEITH; R. RAEDSCH; H. KÄSSMODEL; B. KOMMERELL
err分享
err收藏
Electron transfer by domain movement in cytochrome bc1
err1998-04-01
err0
PREAI
errZhaolei Zhang; Lishar Huang; Vladimir M. Shulmeister; Young-In Chi; Kyeong Kyu Kim; Li-Wei Hung; Antony R. Crofts; Edward A. Berry; Sung-Hou Kim
err分享
err收藏
学者 查看更多内容