arrow
返回

Functional gradient ascent for Probit regression

delete2012-12-01
delete9
PRE
AI
S
Songfeng Zheng *
刘维湘 (Weixiang Liu)
DOI:10.1016/j.patcog.2012.06.006delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper proposes two gradient based methods to fit a Probit regression model by maximizing the sample log-likelihood function. Using the property of the Hessian of the objective function, the first method performs weighted least square regression in each iteration of the Newton-Raphson framework, resulting in ProbitBoost, a boosting-like algorithm. Motivated by the gradient boosting algorithm [10], the second proposed approach maximizes the sample log-likelihood function by updating the fitted function a small step in the gradient direction, performing gradient ascent in functional space, resulting in Gradient ProbitBoost. We also generalize the algorithms to multi-class problems by two strategies, one of which is to use the gradient ascent to maximize the multi-class sample log-likelihood function for fitting all the classifiers simultaneously, and the second approach uses the one-versus-all scheme to reduce the multi-class problem to a series of binary classification problems. The proposed algorithms are tested on typical classification problems including face detection, cancer classification, and handwritten digit recognition. The results show that compared to the alternative methods, the proposed algorithms perform similar or better in terms of testing error rates. (C) 2012 Elsevier Ltd. All rights reserved.
Keyword:
Probit regression
Classification
Functional gradient ascent
Boosting
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

S
shenzhen university
学者数:
4.6W
论文数: 3.4W
被引数: 72
M
Missouri State University
学者数:
977
论文数: 837
被引数: 947
引用论文

引用论文

Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning
err2002-01-01
err2.1K
PREAI
errShipp, MA; Ross, KN; Tamayo, P; Weng, AP; Kutok, JL; Aguiar, RCT; Gaasenbeek, M; Angelo, M; Reich, M; Pinkus, GS; Ray, TS; Koval, MA; Last, KW; Norton, A; Lister, TA; Mesirov, J; Neuberg, DS; Lander, ES; Aster, JC; Golub, TR
err分享
err收藏
Central Retinal Vein Occlusion Associated With Cilioretinal Artery Occlusion
err2008-04-01
err0
PREAI
errSOHAN SINGH HAYREH; LYNN FRATERRIGO; JOST JONAS
err分享
err收藏
5GNOW: Challenging the LTE Design Paradigms of Orthogonality and Synchronicity
err2013-06-01
err0
errOAAI
errGerhard Wunder; Martin Kasparick; Stephan ten Brink; Frank Schaich; Thorsten Wild; Ivan Gaspar; Eckhard Ohlmer; Stefan Krone; Nicola Michailow; Ainoa Navarro; Gerhard Fettweis; Dimitri Ktenas; Vincent Berg; Marcin Dryjanski; Slawomir Pietrzyk; Bertalan Eged
err分享
err收藏
学者 查看更多内容