1
Return

Closed-form estimators for multivariate regressions models: a single categorical variable approach

delete2026-02-28
delete0
PRE
AI
B
Burg, Antoine *
D
Dutang, Christophe
DOI:10.1007/s00180-025-01679-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The maximum likelihood estimator (MLE) remains the most frequently used method to estimate the parameters of generalized linear models. But even for distributions within the exponential family, MLEs are not always tractable and need to be computed with time consuming numerical methods like the Iterative Weighted Least Square algorithm. In order to improve the computation time, closed-form estimators have been found in case of categorical explanatory variables for univariate random variables of one-parameter exponential type. In the context of multivariate generalized linear models (MGLM), we propose a new way to look at the score in case of single categorical variables for any distribution in the exponential family. Firstly, we derive closed-form MLE for MGLM assuming multinomial and negative multinomial distributions. Secondly, we deduce similar results for the multivariate normal distributions. For the Dirichlet distribution, we propose a closed-form estimator, yet not MLE, for which we prove the consistency. We illustrate the computation time gains on simulated datasets: closed-form estimators are about 1000 times faster, especially for high dimension. Closed-form estimators are computed in constant times. Finally, we show the relevancy of the proposed estimator on real-world datasets by modeling cause-of-death mortality in US. We are able to catch the first-order effects of covid between 2019 and 2021.
Keywords:
Maximum likelihood estimation
Multi-parameter exponential family
Closed-form estimators
Computation time
Actuarial mortality model

Journal

C
Computational Statistics
IF:
1.4
Papers:
85
Citations:
2.2K

Organization

C
centre national de la recherche scientifique (cnrs)
Scholars:
24.4W
Papers: 18.1W
Citations: 278
U
université paris-dauphine
Scholars:
19
Papers: 19
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers