Correlation-aware probabilistic data summarization for large-scale multi-block scientific data visualization

Bibliographic Details
Title: Correlation-aware probabilistic data summarization for large-scale multi-block scientific data visualization
Authors: Yang Yang, Kecheng Lu, Yu Wu, Yunhai Wang, Yi Cao
Source: Computational Visual Media, Vol 9, Iss 3, Pp 513-529 (2023)
Publisher Information: SpringerOpen, 2023.
Publication Year: 2023
Collection: LCC:Electronic computers. Computer science
Subject Terms: correlation-awareness, large-scale data, multi-block methods, probabilistic data summarization, Electronic computers. Computer science, QA75.5-76.95
More Details: Abstract In this paper, we propose a correlation-aware probabilistic data summarization technique to efficiently analyze and visualize large-scale multi-block volume data generated by massively parallel scientific simulations. The core of our technique is correlation modeling of distribution representations of adjacent data blocks using copula functions and accurate data value estimation by combining numerical information, spatial location, and correlation distribution using Bayes’ rule. This effectively preserves statistical properties without merging data blocks in different parallel computing nodes and repartitioning them, thus significantly reducing the computational cost. Furthermore, this enables reconstruction of the original data more accurately than existing methods. We demonstrate the effectiveness of our technique using six datasets, with the largest having one billion grid points. The experimental results show that our approach reduces the data storage cost by approximately one order of magnitude compared to state-of-the-art methods while providing a higher reconstruction accuracy at a lower computational cost.
Document Type: article
File Description: electronic resource
Language: English
ISSN: 2096-0433
2096-0662
Relation: https://doaj.org/toc/2096-0433; https://doaj.org/toc/2096-0662
DOI: 10.1007/s41095-022-0304-6
Access URL: https://doaj.org/article/e500bb84340944aca028768f64690009
Accession Number: edsdoj.500bb84340944aca028768f64690009
Database: Directory of Open Access Journals
More Details
ISSN:20960433
20960662
DOI:10.1007/s41095-022-0304-6
Published in:Computational Visual Media
Language:English