arrow
Return

Large Scale Tensor Factorization via Parallel Sketches

delete2022-01-01
delete3
delete
OA
AI
B
Bo Yang *
A
Ahmed S. Zamzam
N
Nicholas D. Sidiropoulos
DOI:10.1109/TKDE.2020.2982144delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Tensor factorization methods have recently gained increased popularity. A key feature that renders tensors attractive is the ability to directly model multi-relational data. In this work, we propose ParaSketch, a parallel tensor factorization algorithm that enables massive parallelism, to deal with large tensors. The idea is to compress the large tensor into multiple small tensors, decompose each small tensor in parallel, and combine the results to reconstruct the desired latent factors. Prior art in this direction entails potentially very high complexity in the (Gaussian) compression and final combining stages. Adopting sketching matrices for compression, the proposed method enjoys a dramatic reduction in compression complexity, and features a much lighter combining step. Moreover, theoretical analysis shows that the compressed tensors inherit latent identifiability under mild conditions, hence establishing correctness of the overall approach. Numerical experiments corroborate the theory and demonstrate the effectiveness of the proposed algorithm.
Keywords:
Tensor factorization
PARAFAC
sketching
block term decomposition
identifiability
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.7K
Citations:
3.2W

Organization

N
national renewable energy laboratory - usa
Scholars:
3.8K
Papers: 2.8K
Citations: 10
U
University of Virginia
Scholars:
3.0W
Papers: 2.7W
Citations: 4.1W
U
united states department of energy (doe)
Scholars:
11.2W
Papers: 9.6W
Citations: 246
researcher View more organizations