返回
Functional gradient ascent for Probit regression
DOI:10.1016/j.patcog.2012.06.006.png)
摘要
En 中文
This paper proposes two gradient based methods to fit a Probit regression model by maximizing the sample log-likelihood function. Using the property of the Hessian of the objective function, the first method performs weighted least square regression in each iteration of the Newton-Raphson framework, resulting in ProbitBoost, a boosting-like algorithm. Motivated by the gradient boosting algorithm [10], the second proposed approach maximizes the sample log-likelihood function by updating the fitted function a small step in the gradient direction, performing gradient ascent in functional space, resulting in Gradient ProbitBoost. We also generalize the algorithms to multi-class problems by two strategies, one of which is to use the gradient ascent to maximize the multi-class sample log-likelihood function for fitting all the classifiers simultaneously, and the second approach uses the one-versus-all scheme to reduce the multi-class problem to a series of binary classification problems. The proposed algorithms are tested on typical classification problems including face detection, cancer classification, and handwritten digit recognition. The results show that compared to the alternative methods, the proposed algorithms perform similar or better in terms of testing error rates. (C) 2012 Elsevier Ltd. All rights reserved.
Keyword:
Probit regression
Classification
Functional gradient ascent
Boosting
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Exploring a fiscal food policy: the case of diet and ischaemic heart disease Commentary: Alternative nutrition outcomes using a fiscal food policy
BMJ
IF0
Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning
NATURE MEDICINE
IF50

