Applying temporal dependence to detect changes in streaming data

doi:10.1007/s10489-018-1254-7

Return

Applying temporal dependence to detect changes in streaming data

2018-07-31

Quang-Huy Duong *

Heri Ramampiaro

Kjetil Nørvåg

DOI：10.1007/s10489-018-1254-7

Original

Save

View PDF

Abstract

En 中文

Detection of changes in streaming data is an important mining task, with a wide range of real-life applications. Numerous algorithms have been proposed to efficiently detect changes in streaming data. However, the limitation of existing algorithms is that they assume that data are generated independently. In particular, temporal dependencies of data in a stream are still not thoroughly studied. Motivated by this, in this work we propose a new efficient method to detect changes in streaming data by exploring the temporal dependencies of data in the stream. As part of this, we introduce a new statistical model called the Candidate Change Point (CCP) model, with which the main idea is to compute the probabilities of finding change points in the stream. The computed probabilities are used to generate a distribution, which is, in turn, used in statistical hypothesis tests to determine the candidate changes. We use the CCP model to develop a new algorithm called Candidate Change Point Detector (CCPD), which detects change points in linear time, and is thus applicable for real-time applications. Our extensive experimental evaluation demonstrates the efficiency and the feasibility of our approach.

Keywords:

Data streams

Change detection

Temporal dependence

Adaptive estimation

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.