arrow
Return

Mutual information scaling for tensor network machine learning

delete2022-01-20
delete12
delete
OA
AI
I
Ian Convy *
W
William J. Huggins
H
Haoran Liao
K
K. Birgitta Whaley
DOI:10.1088/2632-2153/ac44a9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Tensor networks have emerged as promising tools for machine learning, inspired by their widespread use as variational ansatze in quantum many-body physics. It is well known that the success of a given tensor network ansatz depends in part on how well it can reproduce the underlying entanglement structure of the target state, with different network designs favoring different scaling patterns. We demonstrate here how a related correlation analysis can be applied to tensor network machine learning, and explore whether classical data possess correlation scaling patterns similar to those found in quantum states, which might indicate the best network to use for a given dataset. We utilize mutual information (MI) as measure of correlations in classical data, and show that it can serve as a lower-bound on the entanglement needed for a probabilistic tensor network classifier. We then develop a logistic regression algorithm to estimate the MI between bipartitions of data features, and verify its accuracy on a set of Gaussian distributions designed to mimic different correlation patterns. Using this algorithm, we characterize the scaling patterns in the Modified National Institute of Standards and Technology and Tiny Images datasets, and find clear evidence of boundary-law scaling in the latter. This quantum-inspired classical analysis offers insight into the design of tensor networks that are best suited for specific learning tasks.
Keywords:
area law
mutual information
tensor network machine learning

Journal

M
Machine Learning-Science and Technology
IF:
4.6
Papers:
1.1K
Citations:
3.4K

Organization

U
University of California Berkeley
Scholars:
3.5W
Papers: 2.8W
Citations: 11.3W
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K