.png){kind=icon}
Return
Functional gradient ascent for Probit regression
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2012.06.006.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This paper proposes two gradient based methods to fit a Probit regression model by maximizing the sample log-likelihood function. Using the property of the Hessian of the objective function, the first method performs weighted least square regression in each iteration of the Newton-Raphson framework, resulting in ProbitBoost, a boosting-like algorithm. Motivated by the gradient boosting algorithm [10], the second proposed approach maximizes the sample log-likelihood function by updating the fitted function a small step in the gradient direction, performing gradient ascent in functional space, resulting in Gradient ProbitBoost. We also generalize the algorithms to multi-class problems by two strategies, one of which is to use the gradient ascent to maximize the multi-class sample log-likelihood function for fitting all the classifiers simultaneously, and the second approach uses the one-versus-all scheme to reduce the multi-class problem to a series of binary classification problems. The proposed algorithms are tested on typical classification problems including face detection, cancer classification, and handwritten digit recognition. The results show that compared to the alternative methods, the proposed algorithms perform similar or better in terms of testing error rates. (C) 2012 Elsevier Ltd. All rights reserved.
Keywords:
Probit regression
Classification
Functional gradient ascent
Boosting
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
Cited Papers
ShareSaveExploring a fiscal food policy: the case of diet and ischaemic heart disease Commentary: Alternative nutrition outcomes using a fiscal food policy.png)
BMJ
OAAI
BMJIF0
OAAIShareSaveDiffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learningNATURE MEDICINE
NATURE MEDICINEIF50
PREAI
ShareSaveShareSave
View more