arrow
返回

Gradient Tree Boosting for Hierarchical Data

delete2023-01-05
delete9
PRE
AI
M
Marie Salditt *
S
Sarah Humberg
S
Steffen Nestler
DOI:10.1080/00273171.2022.2146638delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Gradient tree boosting is a powerful machine learning technique that has shown good performance in predicting a variety of outcomes. However, when applied to hierarchical (e.g., longitudinal or clustered) data, the predictive performance of gradient tree boosting may be harmed by ignoring the hierarchical structure, and may be improved by accounting for it. Tree-based methods such as regression trees and random forests have already been extended to hierarchical data settings by combining them with the linear mixed effects model (MEM). In the present article, we add to this literature by proposing two algorithms to estimate a combination of the MEM and gradient tree boosting. We report on two simulation studies that (i) investigate the predictive performance of the two MEM boosting algorithms and (ii) compare them to standard gradient tree boosting, standard random forest, and other existing methods for hierarchical data (MEM, MEM random forests, model-based boosting, Bayesian additive regression trees [BART]). We found substantial improvements in the predictive performance of our MEM boosting algorithms over standard boosting when the random effects were non-negligible. MEM boosting as well as BART showed a predictive performance similar to the correctly specified MEM (i.e., the benchmark model), and overall outperformed the model-based boosting and random forest approaches.
Keyword:
Mixed effects models
longitudinal data
regression trees
gradient boosting
atypical observations

期刊

M
Multivariate Behavioral Research
IF:
3.5
论文数:
1.8K
被引数:
9.4K

机构

U
university of munster
学者数:
2.9W
论文数: 2.2W
被引数: 45
引用论文

引用论文

The time-course of threat processing in children: a temporal dissociation between selective attention and behavioral interference
err2012-05-01
err0
PREAI
errLidewij H. Wolters; Else de Haan; Leentje Vervoort; Sanne M. Hogendoorn; Frits Boer; Pier J.M. Prins
err分享
err收藏
Studying the formation of massive stars with VLT/X‐shooter
err2011-03-18
err0
PREAI
errL. Kaper; L.E. Ellerbroek; B.B. Ochsendorf; R.N. Caballero Pouroutidou
err分享
err收藏
Synthesis of Glycocyclopeptides by Click Chemistry and Inhibition Assays with Lectins
err2011-12-14
err0
PREAI
errIsabelle Bossu; Nathalie Berthet; Pascal Dumy; Olivier Renaudet
err分享
err收藏
Plasma Polymerization of TEMPO Yields Coatings Containing Stable Nitroxide Radicals for Controlling Interactions with Prokaryotic and Eukaryotic Cells
err2018-10-24
err0
PREAI
errThomas D. Michl; Jakob Barz; Carla Giles; Michael Haupt; Jan Hinnerk Henze; Joachim Mayer; Kathryn Futrega; Michael Robert Doran; Christian Oehr; Krasimir Vasilev; Bryan R. Coad; Hans Joerg Griesser
err分享
err收藏
err分享
err收藏
OH point defects in olivine from Pakistan
err2009-11-08
err0
PREAI
errJürgen Gose; Esther Schmädicke; Margit Markowitz; Anton Beran
err分享
err收藏
err分享
err收藏
学者 查看更多内容