arrow
返回

SOFTWARE FOR SPARSE TENSOR DECOMPOSITION ON EMERGING COMPUTING ARCHITECTURES

delete2019-06-20
delete32
delete
OA
AI
E
Eric Phipps *
T
Tamara G. Kolda
DOI:10.1137/18M1210691delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In this paper, we develop software for decomposing sparse tensors that is portable to and performant on a variety of multicore, manycore, and GPU computing architectures. The result is a single code whose performance matches optimized architecture-specific implementations. The key to a portable approach is to determine multiple levels of parallelism that can be mapped in different ways to different architectures, and we explain how to do this for the matricized tensor times Khatri-Rao product (MTTKRP), which is the key kernel in canonical polyadic tensor decomposition. Our implementation leverages the Kokkos framework, which enables a single code to achieve high performance across multiple architectures that differ in how they approach fine-grained parallelism. We also introduce a new construct for portable thread-local arrays, which we call compile-time polymorphic arrays. Not only are the specifics of our approaches and implementation interesting for tuning tensor computations, but they also provide a roadmap for developing other portable high-performance codes. As a last step in optimizing performance, we modify the MTTKRP algorithm itself to do a permuted traversal of tensor nonzeros to reduce atomic-write contention. We test the performance of our implementation on 16- and 68-core Intel CPUs and the K80 and P100 NVIDIA GPUs, showing that we are competitive with state-of-the-art architecture-specific codes while having the advantage of being able to run on a variety of architectures.
Keyword:
tensor decomposition
canonical polyadic
MTTKRP
Kokkos
manycore
GPU
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

SIAM Journal on Scientific Computing 封面图
SIAM Journal on Scientific Computing
IF:
2.6
论文数:
5.1K
被引数:
1.8W

机构

U
united states department of energy (doe)
学者数:
11.3W
论文数: 9.6W
被引数: 246
S
Sandia National Laboratories
学者数:
5.5K
论文数: 3.8K
被引数: 6.4K
引用论文

引用论文

Tensor Decompositions and Applications张量分解及其应用
err2009-08-05
err7.5K
PREAI
errKolda, Tamara G.; Bader, Brett W.
err分享
err收藏
err分享
err收藏
A massively parallel tensor contraction framework for coupled-cluster computations
err2014-12-01
err148
PREAI
errSolomonik, Edgar; Matthews, Devin; Hammond, Jeff R.; Stanton, John F.; Demmel, James
err分享
err收藏
Signature Tau Neuropathology in Gray and White Matter of Corticobasal Degeneration
err2002-06-01
err0
errOAAI
errMark S. Forman; Victoria Zhukareva; Catherine Bergeron; Steven S.-M. Chin; Murray Grossman; Chris Clark; Virginia M.-Y. Lee; John Q. Trojanowski
err分享
err收藏
err分享
err收藏
没有更多内容