arrow
Return

Correlation-aware probabilistic data summarization for large-scale multi-block scientific data visualization

delete2023-09-01
delete0
delete
OA
AI
杨扬 cover
杨扬 (Yang Yang)
K
Kecheng Lu
Y
Yu Wu
Y
Yunhai Wang
Y
Yi Cao *
DOI:10.1007/s41095-022-0304-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose a correlation-aware probabilistic data summarization technique to efficiently analyze and visualize large-scale multi-block volume data generated by massively parallel scientific simulations. The core of our technique is correlation modeling of distribution representations of adjacent data blocks using copula functions and accurate data value estimation by combining numerical information, spatial location, and correlation distribution using Bayes' rule. This effectively preserves statistical properties without merging data blocks in different parallel computing nodes and repartitioning them, thus significantly reducing the computational cost. Furthermore, this enables reconstruction of the original data more accurately than existing methods. We demonstrate the effectiveness of our technique using six datasets, with the largest having one billion grid points. The experimental results show that our approach reduces the data storage cost by approximately one order of magnitude compared to state-of-the-art methods while providing a higher reconstruction accuracy at a lower computational cost.
Keywords:
correlation-awareness
large-scale data
multi-block methods
probabilistic data summarization

Journal

Computational Visual Media cover
Computational Visual Media
IF:
18.3
Papers:
310
Citations:
2.6K

Organization

C
chinese academy of sciences
Scholars:
55.3W
Papers: 44.6W
Citations: 704