arrow
Return

NPAC: numeric pattern aware compression algorithm for floating-point time-series data

delete2025-10-27
delete0
PRE
AI
W
Wenjing Wang
刘
刘亮 (Liang Liu) *
K
Kaibin Zhang
杨克虎 cover
杨克虎 (Kehu Yang)
L
Lingwei Kuang
Z
Ziyi Zheng
J
J.A. Wang
J
Junliang Cao
DOI:10.1007/s11280-025-01382-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the rapid development of the Internet of Things (IoT), massive numbers of devices generate vast amounts of time series data. Efficient compression techniques are essential for reducing storage costs and enhancing query performance. Among various data types, floating-point time series data poses significant compression challenges due to its high precision and dynamic range. However, the numerical patterns of time series data vary widely across applications and sensor types, so compression algorithms designed for a single pattern often lack the flexibility to address diverse needs. To overcome this limitation, we propose NPAC, a Numeric Pattern-Aware Compression algorithm for floating-point time-series data. NPAC employs a classification model at the time window level to identify the underlying numerical patterns in the data and introduces a two-layer decision architecture to balance compression ratio and time overhead. In the first layer, several candidate schemes with potentially high compression ratios are selected based on the classification model. In the second layer, a cost function evaluates both compression and decompression time to select the most efficient scheme as the optimal one. We evaluate NPAC against traditional compression algorithms using 18 real-world datasets. The results show that NPAC outperforms the others in most scenarios, achieving an average compression ratio improvement of 61.63%.
Keywords:
Time series database
Lossless compression
Floating-point compression
Machine learning
Data numerical patterns

Journal

W
World Wide Web
IF:
0
Papers:
68
Citations:
0

Organization

C
College of Computer Science and Technology
Scholars:
854
Papers: 298
Citations: 0
Cited Papers

Cited Papers

High-Ratio Lossy Compression: Exploring the Autoencoder to Compress Scientific Data
err2023-02-01
err21
PREAI
errLiu, Tong; Wang, Jinzhen; Liu, Qing; Alibhai, Shakeel; Lu, Tao; He, Xubin
errShare
errSave
SZ3: A Modular Framework for Composing Prediction-Based Error-Bounded Lossy Compressors
err2023-04-01
err23
errOAAI
errLiang, Xin; Zhao, Kai; Di, Sheng; Li, Sihuan; Underwood, Robert; Gok, Ali M.; Tian, Jiannan; Deng, Junjing; Calhoun, Jon C.; Tao, Dingwen; Chen, Zizhong; Cappello, Franck
errShare
errSave
Gorilla
err2015-08-01
err0
PREAI
errTuomas Pelkonen; Scott Franklin; Justin Teller; Paul Cavallaro; Qi Huang; Justin Meza; Kaushik Veeraraghavan
errShare
errSave
TrajMesa: A Distributed NoSQL-Based Trajectory Data Management System
err2022-01-01
err14
errOAAI
errLi, Ruiyuan; He, Huajun; Wang, Rubin; Ruan, Sijie; He, Tianfu; Bao, Jie; Zhang, Junbo; Hong, Liang; Zheng, Yu
errShare
errSave
errShare
errSave
Modeling and analytics for cyber-physical systems in the age of big data
err2014-04-17
err0
errOAAI
errAbhishek B. Sharma; Franjo Ivančić; Alexandru Niculescu-Mizil; Haifeng Chen; Guofei Jiang
errShare
errSave
Fcbench: Cross-domain benchmarking of lossless compression for floating-point data
err
IF0
err2024-05-03
err0
PREAI
errXinyu Chen; Jiannan Tian; Ian Beaver; Cynthia Freeman; Yan Yan; Jianguo Wang; Dingwen Tao
errShare
errSave
Seer: An end-to-end toolkit for benchmarking time series database systems in monitoring applications
err
IF0
err2024-11-08
err0
PREAI
errLuca Althaus; Mourad Khayati; Abdelouahab Khelifati; Anton Dignös; Djellel Difallah; Philippe Cudré-Mauroux
errShare
errSave
Time Series Management Systems: A Survey
err2017-11-01
err116
errOAAI
errJensen, Soren Kejser; Pedersen, Torben Bach; Thomsen, Christian
errShare
errSave
researcher View more