arrow
Return

Variable selection in linear regression: Several approaches based on normalized maximum likelihood

delete2011-08-01
delete15
PRE
AI
C
Ciprian Doru Giurcăneanu *
S
Seyed Alireza Razavi
A
Antti Liski
DOI:10.1016/j.sigpro.2011.03.015delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The use of the normalized maximum likelihood (NML) for model selection in Gaussian linear regression poses troubles because the normalization coefficient is not finite. The most elegant solution has been proposed by Rissanen and consists in applying a particular constraint for the data space. In this paper, we demonstrate that the methodology can be generalized, and we discuss two particular cases, namely the rhomboidal and the ellipsoidal constraints. The new findings are used to derive four NML-based criteria. For three of them which have been already introduced in the previous literature, we provide a rigorous analysis. We also compare them against five state-of-the-art selection rules by conducting Monte Carlo simulations for families of models commonly used in signal processing. Additionally, for the eight criteria which are tested, we report results on their predictive capabilities for real life data sets. (C) 2011 Elsevier B.V. All rights reserved.
Keywords:
Gaussian linear regression
Model selection
Normalized maximum likelihood
Rhomboidal constraint
Ellipsoidal constraint
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Signal Processing cover
Signal Processing
IF:
3.6
Papers:
9.9K
Citations:
1.7W

Organization

T
Tampere University
Scholars:
1.4W
Papers: 1.3W
Citations: 1.4W