arrow
返回

NPAC: numeric pattern aware compression algorithm for floating-point time-series data

delete2025-10-27
delete0
PRE
AI
W
Wenjing Wang
刘
刘亮 (Liang Liu) *
K
Kaibin Zhang
杨克虎 封面图
杨克虎 (Kehu Yang)
L
Lingwei Kuang
Z
Ziyi Zheng
J
J.A. Wang
J
Junliang Cao
DOI:10.1007/s11280-025-01382-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
随着物联网(IoT)的快速发展,大量设备产生了海量时间序列数据。高效的压缩技术对于降低存储成本和提升查询性能至关重要。在各种数据类型中,浮点时间序列数据因其高精度和动态范围而面临显著的压缩挑战。然而,时间序列数据的数值模式在不同应用和传感器类型中差异巨大,因此针对单一模式设计的压缩算法往往缺乏灵活性,难以满足多样化需求。为克服这一局限,我们提出了NPAC,一种面向数值模式的时间序列数据压缩算法。NPAC在时间窗口层面采用分类模型识别数据中的底层数值模式,并引入双层决策架构以平衡压缩比和时间开销。在第一层,基于分类模型选择若干具有潜在高压缩比的候选方案;在第二层,通过成本函数评估压缩与解压时间,选择效率最高的方案作为最优方案。我们使用18个真实数据集将NPAC与传统压缩算法进行比较评估。结果表明,NPAC在多数场景下表现优于其他算法,平均压缩比提升61.63%。
Keyword:
Time series database
Lossless compression
Floating-point compression
Machine learning
Data numerical patterns

期刊

W
World Wide Web
IF:
0
论文数:
68
被引数:
0

机构

C
College of Computer Science and Technology
学者数:
854
论文数: 298
被引数: 0
引用论文

引用论文

High-Ratio Lossy Compression: Exploring the Autoencoder to Compress Scientific Data
err2023-02-01
err21
PREAI
errLiu, Tong; Wang, Jinzhen; Liu, Qing; Alibhai, Shakeel; Lu, Tao; He, Xubin
err分享
err收藏
SZ3: A Modular Framework for Composing Prediction-Based Error-Bounded Lossy Compressors
err2023-04-01
err23
errOAAI
errLiang, Xin; Zhao, Kai; Di, Sheng; Li, Sihuan; Underwood, Robert; Gok, Ali M.; Tian, Jiannan; Deng, Junjing; Calhoun, Jon C.; Tao, Dingwen; Chen, Zizhong; Cappello, Franck
err分享
err收藏
Gorilla
err2015-08-01
err0
PREAI
errTuomas Pelkonen; Scott Franklin; Justin Teller; Paul Cavallaro; Qi Huang; Justin Meza; Kaushik Veeraraghavan
err分享
err收藏
TrajMesa: A Distributed NoSQL-Based Trajectory Data Management System
err2022-01-01
err14
errOAAI
errLi, Ruiyuan; He, Huajun; Wang, Rubin; Ruan, Sijie; He, Tianfu; Bao, Jie; Zhang, Junbo; Hong, Liang; Zheng, Yu
err分享
err收藏
err分享
err收藏
Modeling and analytics for cyber-physical systems in the age of big data
err2014-04-17
err0
errOAAI
errAbhishek B. Sharma; Franjo Ivančić; Alexandru Niculescu-Mizil; Haifeng Chen; Guofei Jiang
err分享
err收藏
Fcbench: Cross-domain benchmarking of lossless compression for floating-point dataFcbench:针对浮点数据的无损压缩跨域基准测试
err
IF0
err2024-05-03
err0
PREAI
errXinyu Chen; Jiannan Tian; Ian Beaver; Cynthia Freeman; Yan Yan; Jianguo Wang; Dingwen Tao
err分享
err收藏
Seer: An end-to-end toolkit for benchmarking time series database systems in monitoring applicationsSeer: 用于监控应用中时间序列数据库系统基准测试的端到端工具包
err
IF0
err2024-11-08
err0
PREAI
errLuca Althaus; Mourad Khayati; Abdelouahab Khelifati; Anton Dignös; Djellel Difallah; Philippe Cudré-Mauroux
err分享
err收藏
Time Series Management Systems: A Survey
err2017-11-01
err116
errOAAI
errJensen, Soren Kejser; Pedersen, Torben Bach; Thomsen, Christian
err分享
err收藏
学者 查看更多内容