arrow
Return

A Block Minorization-Maximization Algorithm for Heteroscedastic Regression

delete2016-08-01
delete1
delete
OA
AI
H
Hien D. Nguyen *
L
Luke R. Lloyd‐Jones
G
Geoffrey J. McLachlan
DOI:10.1109/LSP.2016.2586180delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The computation of the maximum likelihood (ML) estimator for heteroscedastic regression models is considered. The traditional Newton algorithms for the problem require matrix multiplications and inversions, which are bottlenecks in modern Big Data contexts. A new Big Data-appropriate minorization-maximization (MM) algorithm is considered for the computation of the ML estimator. The MM algorithm is proved to generate monotonically increasing sequences of likelihood values and to be convergent to a stationary point of the log-likelihood function. A distributed and parallel implementation of the MM algorithm is presented, and the MM algorithm is shown to have differing time complexity to the Newton algorithm. Simulation studies demonstrate that the MM algorithm improves upon the computation time of the Newton algorithm in some practical scenarios where the number of observations is large.
Keywords:
Heteroscedastic regression
minorization-maximization (MM) algorithm
maximum likelihood (ML) estimation
parallel algorithm

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

U
University of Queensland
Scholars:
5.0W
Papers: 5.1W
Citations: 9.2W
Cited Papers

Cited Papers

2-D Material Molybdenum Disulfide Analyzed by XPS
err2014-07-09
err0
PREAI
errD. Ganta; S. Sinha; Richard T. Haasch
errShare
errSave
A NOTE ON PARALLEL MATRIX INVERSION
err2001-01-01
err59
PREAI
errQuintana, Enrique S.; Quintana, Gregorio; Sun, Xiaobai; van de Geijn, Robert
errShare
errSave
Data Mining with Big Data
err2014-01-01
err1.9K
PREAI
errWu, Xindong; Zhu, Xingquan; Wu, Gong-Qing; Ding, Wei
errShare
errSave
researcher View more