arrow
Return

Differentiable Programming Tensor Networks

delete2019-09-05
delete172
delete
OA
AI
H
Haijun Liao
J
Jin-Guo Liu
王
王雷 (Lei Wang) *
Tao Xiang cover
Tao Xiang (Tao Xiang)
DOI:10.1103/PhysRevX.9.031041delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Differentiable programming is a fresh programming paradigm which composes parameterized algorithmic components and optimizes them using gradient search. The concept emerges from deep learning but is not limited to training neural networks. We present the theory and practice of programming tensor network algorithms in a fully differentiable way. By formulating the tensor network algorithm as a computation graph, one can compute higher-order derivatives of the program accurately and efficiently using automatic differentiation. We present essential techniques to differentiate through the tensor networks contraction algorithms, including numerical stable differentiation for tensor decompositions and efficient backpropagation through fixed-point iterations. As a demonstration, we compute the specific heat of the Ising model directly by taking the second-order derivative of the free energy obtained in the tensor renorrnalization group calculation. Next, we perform gradient-based variational optimization of infinite projected entangled pair states for the quantum antiferromagnetic Heisenberg model and obtain state-of-the-art variational energy and magnetization with moderate efforts. Differentiable programming removes laborious human efforts in deriving and implementing analytical gradients for tensor network programs, which opens the door to more innovations in tensor network algorithms and applications.
Keywords:
MATRIX RENORMALIZATION-GROUP
AUTOMATIC DIFFERENTIATION
QUANTUM COMPUTATION
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Physical Review X cover
Physical Review X
IF:
15.7
Papers:
2.7K
Citations:
3.4W

Organization

C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

errShare
errSave
Holographic duality from random tensor networks
err2016-11-02
err440
errOAAI
errHayden, Patrick; Nezami, Sepehr; Qi, Xiao-Liang; Thomas, Nathaniel; Walter, Michael; Yang, Zhao
errShare
errSave
Infinite projected entangled pair states algorithm improved: Fast full update and gauge fixing
err2015-07-24
err151
errOAAI
errPhien, Ho N.; Bengua, Johann A.; Tuan, Hoang D.; Corboz, Philippe; Orus, Roman
errShare
errSave
errShare
errSave
Non-Abelian chiral spin liquid in a quantum antiferromagnet revealed by an iPEPS study
err2018-11-08
err64
errOAAI
errChen, Ji-Yao; Vanderstraeten, Laurens; Capponi, Sylvain; Poilblanc, Didier
errShare
errSave
Silver Nanoparticles as Antimicrobial Agents
err2017-01-01
err0
PREAI
errLuciano P. Silva; Ariane P. Silveira; Cínthia C. Bonatto; Ivy G. Reis; Paulo V. Milreu
errShare
errSave
researcher View more