.png){kind=icon}
返回
TAC plus : Optimizing Error-Bounded Lossy Compression for 3D AMR Simulations
.png){kind=icon}
OA
AI
DOI：10.1109/TPDS.2023.3339474.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Today's scientific simulations require significant data volume reduction because of the enormous amounts of data produced and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one of the most effective solutions to the above problem. However, little work has been done to improve error-bounded lossy compression for Adaptive Mesh Refinement (AMR) simulation data. Unlike the previous work that only leverages 1D compression, in this work, we propose an approach (TAC) to leverage high-dimensional SZ compression for each refinement level of AMR data. To remove the data redundancy across different levels, we propose several pre-process strategies and adaptively use them based on the data features. We further optimize TAC to TAC+ by improving the lossless encoding stage of SZ compression to handle many small AMR data blocks after the pre-processing efficiently. Experiments on 10 AMR datasets from three real-world large-scale AMR simulations demonstrate that TAC+ can improve the compression ratio by up to 4.9x under the same data distortion, compared to the state-of-the-art method. In addition, we leverage the flexibility of our approach to tune the error bound for each level, which achieves much lower data distortion on two application-specific metrics.
Keyword:
Adaptive mesh refinement (AMR)
data reduction
lossy compression
scientific computing
期刊
IF:
6
论文数:
5.2K
被引数:
1.1W
机构
引用论文
Benzodiazepine Antagonists An Update of Their Role in the Emergency Care of Overdose Patients.png)
Drug Safety
Drug SafetyIF0
PREAI
分享收藏分享收藏分享收藏HFCVD diamond growth on Cu(111). Evidence for carbon phase transformations by in situ AES and XPS
PREAI
分享收藏
查看更多内容