.png){kind=icon}
返回
MGARD plus : Optimizing Multilevel Methods for Error-Bounded Scientific Data Reduction
.png){kind=icon}
OA
AI
DOI：10.1109/TC.2021.3092201.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Nowadays, data reduction is becoming increasingly important in dealing with the large amounts of scientific data. Existing multilevel compression algorithms offer a promising way to manage scientific data at scale, but may suffer from relatively low performance and reduction quality. In this paper, we propose MGARD+, a multilevel data reduction and refactoring framework drawing on previous multilevel methods, to achieve high-performance data decomposition and high-quality error-bounded lossy compression. Our contributions are four-fold: 1) We propose to leverage a level-wise coefficient quantization method, which uses different error tolerances to quantize the multilevel coefficients. 2) We propose an adaptive decomposition method which treats the multilevel decomposition as a preconditioner and terminates the decomposition process at an appropriate level. 3) We leverage a set of algorithmic optimization strategies to significantly improve the performance of multilevel decomposition/recomposition. 4) We evaluate our proposed method using four real-world scientific datasets and compare with several state-of-the-art lossy compressors. Experiments demonstrate that our optimizations improve the decomposition/recomposition performance of the existing multilevel method by up to 70x, and the proposed compression method can improve compression ratio by up to 2x compared with other state-of-the-art error-bounded lossy compressors under the same level of data distortion.
Keyword:
High-performance computing
lossy compression
multilevel decomposition
error control
scientific data
期刊
IF:
3.8
论文数:
5.4K
被引数:
9.8K
机构
引用论文
分享收藏分享收藏Heavy metal tolerance of filamentous fungal strains isolated from soil irrigated with industrial wastewater.png)
Biologija
BiologijaIF0
PREAI
分享收藏CuO and Co3O4 Nanoparticles: Synthesis, Characterizations, and Raman SpectroscopyCuO和Co3O4 纳米粒子: 合成、表征和拉曼光谱
OAAI
OAAI分享收藏HFCVD diamond growth on Cu(111). Evidence for carbon phase transformations by in situ AES and XPS
PREAI
分享收藏
查看更多内容