arrow
返回

ZFP: A compressed array representation for numerical computations

delete2024-10-23
delete0
PRE
AI
P
Peter Lindström *
J
J. Hittinger
J
James Diffenderfer
A
Alyson Fox
D
Daniel Osei-Kuffuor
J
Jeffrey W. Banks
DOI:10.1177/10943420241284023delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
HPC trends favor algorithms and implementations that reduce data motion relative to FLOPS. We investigate the use of lossy compressed data arrays in place of traditional IEEE floating point arrays to store the primary data of calculations. Simulation is fundamentally an exercise in controlled approximation, and error introduced by finite-precision arithmetic (or lossy compression) is just one of several sources of error that need to be managed to ensure sufficient accuracy in a computed result. We describe ZFP, a compressed numerical format designed for in-memory storage of multidimensional arrays, and summarize theoretical results that demonstrate that the error of repeated lossy compression can be bounded and controlled. Furthermore, we establish a relationship between grid resolution and compression-induced errors and show that, contrary to conventional floating point, ZFP reduces finite-difference errors with finer grids. We present example calculations that demonstrate data reduction by 4x or more with negligible impact on solution accuracy. Our results further demonstrate several orders-of-magnitude increase in accuracy using ZFP over IEEE floating point and Posits for the same storage budget.
Keyword:
Lossy compression
reduced precision
number representations
error analysis
partial differential equations

期刊

International Journal of High Performance Computing Applications 封面图
International Journal of High Performance Computing Applications
IF:
2.5
论文数:
1.1K
被引数:
1.3K

机构

L
Lawrence Livermore National Laboratory
学者数:
6.0K
论文数: 3.8K
被引数: 9
U
united states department of energy (doe)
学者数:
11.3W
论文数: 9.6W
被引数: 246
引用论文

引用论文

A survey of numerical linear algebra methods utilizing mixed-precision arithmetic
err2021-03-19
err80
PREAI
errAbdelfattah, Ahmad; Anzt, Hartwig; Boman, Erik G.; Carson, Erin; Cojean, Terry; Dongarra, Jack; Fox, Alyson; Gates, Mark; Higham, Nicholas J.; Li, Xiaoye S.; Loe, Jennifer; Luszczek, Piotr; Pranesh, Srikara; Rajamanickam, Siva; Ribizel, Tobias; Smith, Barry F.; Swirydowicz, Kasia; Thomas, Stephen; Tomov, Stanimire; Tsai, Yaohung M.; Yang, Ulrike Meier
err分享
err收藏
Nitrogen metabolism in the ectomycorrhizal fungus Hebeloma crustuliniforme
err2006-04-28
err0
errOAAI
errALI M. QUORESHI; IFTIKHAR AHMAD; DAVID MALLOCH; JOHAN A. HELLEBUST
err分享
err收藏
Developing nursing research
err2005-11-01
err0
PREAI
errLinda Bradbury; Kim Clipsham; Alison Kitson
err分享
err收藏
Results of the Pegasus Phase 3 Randomized Trial Demonstrating Superiority of the C3 Inhibitor, Pegcetacoplan, Compared to Eculizumab in Patients with Paroxysmal Nocturnal Hemoglobinuria
err2020-11-05
err0
PREAI
errPeter Hillmen; Jeffrey Szer; Ilene C. Weitz; Alexander Röth; Britta Hoechsmann; Jens Panse; Kensuke Usuki; Morag Griffin; Jean-Jacques Kiladjian; Carlos M. de Castro; Hisakazu Nishimori; Lisa Tan; Mohamed Hamdani; Pascal Deschatelets; Cedric Francois; Federico Grossi; Antonio Risitano; Regis Peffault De Latour
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容