arrow
Return

Interaction decompositions for tensor network regression

delete2022-12-20
delete1
delete
OA
AI
I
Ian Convy *
K
K. Birgitta Whaley
DOI:10.1088/2632-2153/aca271delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
It is well known that tensor network regression models operate on an exponentially large feature space, but questions remain as to how effectively they are able to utilize this space. Using a polynomial featurization, we propose an interaction decomposition as a tool that can assess the relative importance of different regressors as a function of their polynomial degree. We apply this decomposition to tensor ring and tree tensor network models trained on the MNIST and Fashion MNIST datasets, and find that up to 75% of interaction degrees are contributing meaningfully to these models. We also introduce a new type of tensor network model that is explicitly trained on only a small subset of interaction degrees, and find that these models are able to match or even outperform the full models using only a fraction of the exponential feature space. This suggests that standard tensor network models utilize their polynomial regressors in an inefficient manner, with the lower degree terms being vastly under-utilized.
Keywords:
tensor regression
interaction decomposition
tensor network machine learning

Journal

M
Machine Learning-Science and Technology
IF:
4.6
Papers:
1.1K
Citations:
3.4K

Organization

University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
Cited Papers

Cited Papers

Simulating strongly correlated quantum systems with tree tensor networks
err2010-11-03
err175
errOAAI
errMurg, V.; Verstraete, F.; Legeza, Oe.; Noack, R. M.
errShare
errSave
Tensor Decompositions and Applications
err2009-08-05
err7.5K
PREAI
errKolda, Tamara G.; Bader, Brett W.
errShare
errSave
err1998-01-01
err0
PREAI
errM. Baeva; A. Beskrovnyi; S. Danilkin; E. Jadrovski
errShare
errSave
OXIDATION OF FERRIC PORPHYRINS*
err2006-12-16
err0
PREAI
errR. H. Felton; G. S. Owen; D. Dolphin; A. Forman; D. C. Borg; J. Fajer
errShare
errSave
researcher View more