arrow
Return

Condensed-gradient boosting

delete2024-07-23
delete0
delete
OA
AI
S
Seyedsaman Emami *
G
Gonzalo Martínez-Muñoz
DOI:10.1007/s13042-024-02279-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper presents a computationally efficient variant of Gradient Boosting (GB) for multi-class classification and multi-output regression tasks. Standard GB uses a 1-vs-all strategy for classification tasks with more than two classes. This strategy entails that one tree per class and iteration has to be trained. In this work, we propose the use of multi-output regressors as base models to handle the multi-class problem as a single task. In addition, the proposed modification allows the model to learn multi-output regression problems. An extensive comparison with other multi-output based Gradient Boosting methods is carried out in terms of generalization and computational efficiency. The proposed method showed the best trade-off between generalization ability and training and prediction speeds. Furthermore, an analysis of space and time complexity was undertaken.
Keywords:
Gradient boosting machine
Multi-output regression
Multi-class classification

Journal

International Journal of Machine Learning and Cybernetics cover
International Journal of Machine Learning and Cybernetics
IF:
2.7
Papers:
3.1K
Citations:
5.6K

Organization

A
Autonomous University of Madrid
Scholars:
2.1W
Papers: 1.7W
Citations: 29