arrow
Return

GPU-accelerated Kendall distance computation for large or sparse data

delete2024-12-09
delete0
delete
OA
AI
P
Pavel Akhtyamov
A
Ausaaf Nabi
V
Vladislav Gafurov
A
Alexey Sizykh
A
Alexander V. Favorov
Y
Yulia A. Medvedeva
A
Alexey Stupnikov *
DOI:10.1093/gigascience/giae088delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Background Current experimental practices typically produce large multidimensional datasets. Distance matrix calculation between elements (e.g., samples) for such data, although being often necessary in preprocessing for statistical inference or visualization, can be computationally demanding. Data sparsity, which is often observed in various experimental data modalities, such as single-cell sequencing in bioinformatics or collaborative filtering in recommendation systems, may pose additional algorithmic challenges.Results We present GPU-Assisted Distance Estimation Software (GADES), a graphical processing unit (GPU)-enhanced package that allows for massively paralleled Kendall-$\tau$ distance matrices computation. The package's architecture involves specific memory management, which lifts the limits for the data size imposed by GPU memory capacity. Additional algorithmic solutions provide a means to address the data sparsity problem and reinforce the acceleration effect for sparse datasets. Benchmarking against available central processing unit-based packages on simulated and real experimental single-cell RNA sequencing or single-cell ATAC sequencing datasets demonstrated significantly higher speed for GADES compared to other methods for both sparse and dense data processing, with additional performance boost for the sparse data.Conclusions This work significantly contributes to the development of computational strategies for high-performance Kendall distance matrices computation and allows for the efficient processing of Big Data with the power of GPU. GADES is freely available at https://github.com/lab-medvedeva/GADES-main.
Keywords:
Kendall correlation
distance matrix
GPU
parallel computation
high dimension
scRNA-seq
scATAC-seq
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

GigaScience cover
GigaScience
IF:
3.9
Papers:
1.6K
Citations:
1.2W

Organization

M
moscow institute of physics & technology
Scholars:
4.5K
Papers: 3.0K
Citations: 3
J
Johns Hopkins Medicine
Scholars:
1.8W
Papers: 1.3W
Citations: 5.0W