arrow
Return

TERM Model: Tensor Ring Mixture Model for Density Estimation

delete2025-12-24
delete0
PRE
AI
R
Ruituo Wu
J
Jiani Liu
B
Bing Li
A
Anh Huy Phan
I
Ivan Oseledets
C
Ce Zhu
Y
Yipeng Liu
DOI:10.1109/TBDATA.2025.3648288delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Probabilistic modeling is a core challenge in statistical machine learning. Tensor-based probabilistic graph methods address interpretability and stability concerns encountered in neural network approaches and allow tractable inference (e.g., marginal inference and conditional inference). In this paper, we introduce tensor ring decomposition for density estimation, which reduces the number of permutation candidates compared to existing methods, while simultaneously enhancing expressive power and maintaining tractable inference. Different non-negative strategies for density function results in two variants: Born TRDE offers simpler inference and sampling but with slightly lower accuracy, while Energy TRDE, though more complex, achieves superior performance. Furthermore, a mixture model that incorporates multiple permutation candidates with adaptive weights is designed, resulting in increased expressive flexibility and comprehensiveness. Unlike existing methods that focus on finding a single optimal permutation, our approach, inspired by ensemble learning, demonstrates that combining multiple suboptimal permutations can yield superior results. Experiments demonstrate that the proposed approach excels in estimating probability density functions and sampling, capturing intricate details with competitive or superior performance compared to existing state-of-the-art (SOTA) tractable density methods.
Keywords:
Statistical learning
probability density function
tractable inference
tensor ring decomposition

Journal

I
IEEE Transactions on Big Data
IF:
5.7
Papers:
834
Citations:
3.0K

Organization

U
university of electronic science and technology of china
Scholars:
1.2W
Papers: 4.4K
Citations: 4
S
skolkovo institute of science and technology
Scholars:
254
Papers: 104
Citations: 0