arrow
Return

Large-Scale Datastreams Surveillance via Pattern-Oriented-Sampling

delete2020-10-23
delete11
delete
OA
AI
任浩杰 (Haojie Ren)
C
Changliang Zou *
N
Nan Chen
R
Runze Li *
DOI:10.1080/01621459.2020.1819295delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Monitoring large-scale datastreams with limited resources has become increasingly important for real-time detection of abnormal activities in many applications. Despite the availability of large datasets, the challenges associated with designing an efficient change-detection when clustering or spatial pattern exists are not yet well addressed. In this article, a design-adaptive testing procedure is developed when only a limited number of streaming observations can be accessed at each time. We derive an optimal sampling strategy, the pattern-oriented-sampling, with which the proposed test possesses asymptotically and locally best power under alternatives. Then, a sequential change-detection procedure is proposed by integrating this test with generalized likelihood ratio approach. Benefiting from dynamically estimating the optimal sampling design, the proposed procedure is able to improve the sensitivity in detecting clustered changes compared with existing procedures. Its advantages are demonstrated in numerical simulations and a real data example. Ignoring the neighboring information of spatially structured data will tend to diminish the detection effectiveness of traditional detection procedures. for this article are available online.
Keywords:
Design-adaptive test
Generalized likelihood ratio method
Kernel smoothing
Optimal sampling
Sequential change detection
Statistical monitoring
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.1K
Citations:
4.8W

Organization

S
shanghai jiao tong university
Scholars:
15.5W
Papers: 11.6W
Citations: 159
P
pennsylvania commonwealth system of higher education (pcshe)
Scholars:
12.9W
Papers: 11.7W
Citations: 177
N
nankai university
Scholars:
4.7W
Papers: 3.2W
Citations: 74
researcher View more organizations