arrow
Return

Conditional Probability Tensor Decompositions for Multivariate Categorical Response Regression

delete2026-03-01
delete1
PRE
AI
A
Aaron J. Molstad *
X
Xin Zhang
DOI:10.1080/01621459.2025.2567045delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In many modern regression applications, the response consists of multiple categorical random variables whose probability mass is a function of a common set of predictors. In this article, we propose a new method for modeling such a probability mass function in settings where the number of response variables, the number of categories per response, and the dimension of the predictor are large. Our method relies on a functional probability tensor decomposition: a decomposition of a tensor-valued function such that its range is a restricted set of low-rank probability tensors. This decomposition is motivated by the connection between the conditional independence of responses, or lack thereof, and their probability tensor rank. We show that the model implied by such a low-rank functional probability tensor decomposition can be interpreted in terms of a mixture of regressions and can thus be fit using maximum likelihood. We derive an efficient and scalable penalized expectation maximization algorithm to fit this model and examine its statistical properties. We demonstrate the encouraging performance of our method through both simulation studies and an application to modeling the functional classes of genes. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.
Keywords:
Dimension reduction
Generalized linear model
Latent variable model
Mixture regression
Tensor decomposition

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.1K
Citations:
4.8W

Organization

U
university of minnesota twin cities
Scholars:
2.1K
Papers: 1.2K
Citations: 0
U
university of minnesota system
Scholars:
3.0K
Papers: 1.3K
Citations: 0