arrow
返回

Partitioning Models for General Medium-Grain Parallel Sparse Tensor Decomposition

delete2021-01-01
delete10
PRE
AI
M
M. Ozan Karsavuran
S
Seher Acer
C
Cevdet Aykanat *
DOI:10.1109/TPDS.2020.3012624delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The focus of this article is efficient parallelization of the canonical polyadic decomposition algorithm utilizing the alternating least squares method for sparse tensors on distributed-memory architectures. We propose a hypergraph model for general medium-grain partitioning which does not enforce any topological constraint on the partitioning. The proposed model is based on splitting the given tensor into nonzero-disjoint component tensors. Then a mode-dependent coarse-grain hypergraph is constructed for each component tensor. A net amalgamation operation is proposed to form a composite medium-grain hypergraph from these mode-dependent coarse-grain hypergraphs to correctly encapsulate the minimization of the communication volume. We propose a heuristic which splits the nonzeros of dense slices to obtain sparse slices in component tensors. So we partially attain slice coherency at (sub)slice level since partitioning is performed on (sub)slices instead of individual nonzeros. We also utilize the well-known recursive-bipartitioning framework to improve the quality of the splitting heuristic. Finally, we propose a medium-grain tripartite graph model with the aim of a faster partitioning at the expense of increasing the total communication volume. Parallel experiments conducted on 10 real-world tensors on up to 1024 processors confirm the validity of the proposed hypergraph and graph models.
Keyword:
Tensile stress
Program processors
Partitioning algorithms
Computational modeling
Sparse matrices
Load modeling
Minimization
sparse tensor
tensor decomposition
canonical polyadic decomposition
communication cost
communication volume
medium-grain partitioning
recursive bipartitioning
hypergraph partitioning
graph partitioning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

I
ihsan dogramaci bilkent university
学者数:
3.6K
论文数: 3.5K
被引数: 8
U
united states department of energy (doe)
学者数:
11.3W
论文数: 9.6W
被引数: 246
引用论文

引用论文

Reactions of disubstituted alkanes with a nickel(I) macrocycle
err2002-05-01
err0
PREAI
errM. S. Ram; Andreja Bakac; James H. Espenson
err分享
err收藏
Plastic change of prefrontal cortex mediates anxiety-like behaviors associated with chronic pain in neuropathic rats
err2018-06-06
err0
errOAAI
errKangning Sang; Chaofei Bao; Yushi Xin; Shunan Hu; Xian Gao; Yongsheng Wang; Mark Bodner; Yong-Di Zhou; Xiao-Wei Dong
err分享
err收藏
Tensor Decompositions and Applications张量分解及其应用
err2009-08-05
err7.5K
PREAI
errKolda, Tamara G.; Bader, Brett W.
err分享
err收藏
Genetic changes in localized prostate cancer of Japanese patients shown by comparative genomic hybridization
err2005-05-01
err0
PREAI
errKotaro Kasahara; Takahiro Taguchi; Ichiro Yamasaki; Masayuki Kamada; Taro Shuin
err分享
err收藏
学者 查看更多内容