arrow
Return

Tensor Networks for Latent Variable Analysis: Novel Algorithms for Tensor Train Approximation

delete2020-11-01
delete17
PRE
AI
A
Anh Huy Phan *
A
Andrzej Cichocki
A
André Uschmajew
P
Petr Tichavský
G
George Luta
D
Danilo P. Mandic
DOI:10.1109/TNNLS.2019.2956926delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Decompositions of tensors into factor matrices, which interact through a core tensor, have found numerous applications in signal processing and machine learning. A more general tensor model that represents data as an ordered network of subtensors of order-2 or order-3 has, so far, not been widely considered in these fields, although this so-called tensor network (TN) decomposition has been long studied in quantum physics and scientific computing. In this article, we present novel algorithms and applications of TN decompositions, with a particular focus on the tensor train (TT) decomposition and its variants. The novel algorithms developed for the TT decomposition update, in an alternating way, one or several core tensors at each iteration and exhibit enhanced mathematical tractability and scalability for large-scale data tensors. For rigor, the cases of the given ranks, given approximation error, and the given error bound are all considered. The proposed algorithms provide well-balanced TT-decompositions and are tested in the classic paradigms of blind source separation from a single mixture, denoising, and feature extraction, achieving superior performance over the widely used truncated algorithms for TT decomposition.
Keywords:
Tensors
Approximation algorithms
Signal processing algorithms
Matrix decomposition
Signal processing
Data models
Approximation error
Blind source separation
image denoising
nested Tucker
tensor network (TN)
tensor train (TT) decomposition
tensorization
Tucker-2 (TK2) decomposition
truncated singular value decomposition (SVD)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

S
skolkovo institute of science & technology
Scholars:
3.3K
Papers: 2.3K
Citations: 1
C
czech academy of sciences
Scholars:
3.4W
Papers: 2.6W
Citations: 31
I
Imperial College London
Scholars:
8.3W
Papers: 7.3W
Citations: 11.1W
G
Georgetown University
Scholars:
1.6W
Papers: 1.3W
Citations: 1.5W
researcher View more organizations