arrow
Return

A new algorithm for correcting irregular patterns associated with timestamp error in spatial correlated sensor data

delete2026-10-01
delete0
delete
OA
AI
N
Natalie D. Benschop *
T
Temesgen Zewotir
R
Rajen N. Naidoo
DOI:10.1186/s40537-026-01571-wdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Timestamp error commonly occurs in the capture of sensor-dependent data, and the impact can be profound. Yet, literature remains scarce on addressing this big-data challenge, particularly within the domain of environmental monitoring. In this paper, we propose an algorithm for precise realignment of displaced sequences of data when the occurrence of timestamp error in data captured by certain air monitoring stations within a spatial network manifests as an irregular diurnal pattern. The algorithm may be generalizable to other domains too, given the simple premise of gradually shifting and comparing the displaced measurements of one select variable from the multivariate set, to data positioned at corresponding time points in multiple imputed representations. A pooled measure of mean absolute scaled error is used to identify the required shift for data repair. The algorithm was stress-tested in a univariate simulation study against baseline methods, and was found to be superior and highly reliable in the exact correction of contrived sequences of displaced air temperature data, particularly under conditions of strong cross-correlation between series recorded at different locations. The algorithm was further applied to an empirical case of timestamp error in multivariate data, with sensitivity analysis yielding robust and consistent results.
Keywords:
Timestamp correction
Displaced data
Irregular patterns
Spatial
Correlated
Multivariate
Air monitoring
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Big Data cover
Journal of Big Data
IF:
6.4
Papers:
1.5K
Citations:
1.1W

Organization

U
university of kwazulu natal
Scholars:
140
Papers: 64
Citations: 0
Cited Papers

Cited Papers

No cited papers available