arrow
Return

Greedy function approximation: A gradient boosting machine

delete2001-10-01
delete2.0W
delete
OA
AI
J
Jerome H. Friedman
DOI:10.1214/aos/1013203451delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Function estimation/approximation is viewed from the perspective of numerical optimization in function space, rather than parameter space. A connection is made between stagewise additive expansions and steepest-descent minimization. A general gradient descent boosting paradigm is developed for additive expansions based on any fitting criterion. Specific algorithms are presented for least-squares, least absolute deviation, and Huber-M loss functions for regression, and multiclass logistic likelihood for classification. Special enhancements are derived for the particular case where the individual additive components are regression trees, and tools for interpreting such TreeBoost models are presented. Gradient boosting of regression trees produces competitive, highly robust, interpretable procedures for both regression and classification, especially appropriate for ruining less than clean data. Connections between this approach and the boosting methods of Freund and Shapire and Friedman, Hastie and Tibshirani are discussed.
Keywords:
function estimation
boosting
decision trees
robust nonparametric regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

No organization information available
Cited Papers

Cited Papers

Volatile Constituents ofPeperomia subespatulata
err2007-01-24
err0
PREAI
errAura De Díaz; Pedro Díaz; Hernán Cardoso
errShare
errSave
Diseases and Molecular Diagnostics: A Step Closer to Precision Medicine
err2017-08-22
err0
errOAAI
errShailendra Dwivedi; Purvi Purohit; Radhieka Misra; Puneet Pareek; Apul Goel; Sanjay Khattri; Kamlesh Kumar Pant; Sanjeev Misra; Praveen Sharma
errShare
errSave
errShare
errSave
Finsta
err2019-05-02
err0
PREAI
errSofia Dewar; Schinria Islam; Elizabeth Resor; Niloufar Salehi
errShare
errSave
Mobile markerless augmented reality and its application in forensic medicine
err2014-08-23
err0
PREAI
errThomas Kilgus; Eric Heim; Sven Haase; Sabine Prüfer; Michael Müller; Alexander Seitel; Markus Fangerau; Tamara Wiebe; Justin Iszatt; Heinz-Peter Schlemmer; Joachim Hornegger; Kathrin Yen; Lena Maier-Hein
errShare
errSave
Update on the Treatment of Metastatic Urothelial Carcinoma
err2018-06-06
err0
errOAAI
errNedal Bukhari; Humaid O. Al-Shamsi; Faisal Azam
errShare
errSave
Two-dimensional bricklayer arrangements of tolans using halogen bonding interactions
err2015-01-01
err0
PREAI
errFanny Frausto; Zachary C. Smith; Terry E. Haas; Samuel W. Thomas III
errShare
errSave
researcher View more