arrow
Return

AN INCREMENTAL TENSOR TRAIN DECOMPOSITION ALGORITHM

delete2024-03-26
delete2
delete
OA
AI
D
Doruk Aksoy *
D
David Gorsich
S
Shravan Veerapaneni
DOI:10.1137/22M1537734delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a new algorithm for incrementally updating the tensor train decomposition of a stream of tensor data. This new algorithm, called the tensor train incremental core expansion (TT-ICE), improves upon the current state-of-the-art algorithms for compressing in tensor train format by developing a new adaptive approach that incurs significantly slower rank growth and guarantees compression accuracy. This capability is achieved by limiting the number of new vectors appended to the TT-cores of an existing accumulation tensor after each data increment. These vectors represent directions orthogonal to the span of existing cores and are limited to those needed to represent a newly arrived tensor to a target accuracy. We provide two versions of the algorithm: TT-ICE and TT-ICE accelerated with heuristics (TT-ICE\ast). \ast ). We provide a proof of correctness for TT-ICE and empirically demonstrate the performance of the algorithms in compressing largescale video and scientific simulation datasets. Compared to existing approaches that also use rank adaptation, TT-ICE\ast \ast achieves 57\times higher compression and up to 95\% reduction in computational time.
Keywords:
tensor decompositions
data compression
streaming data
low-rank factorizations

Journal

SIAM Journal on Scientific Computing cover
SIAM Journal on Scientific Computing
IF:
2.6
Papers:
5.1K
Citations:
1.8W

Organization

U
University of Michigan
Scholars:
6.4W
Papers: 5.3W
Citations: 124
U
university of michigan system
Scholars:
9.1W
Papers: 8.6W
Citations: 133