arrow
返回

A hybrid ensemble method with negative correlation learning for regression

delete2023-08-23
delete1
PRE
AI
Y
Yun Bai
G
Ganglin Tian
Y
Yanfei Kang *
S
Suling Jia
DOI:10.1007/s10994-023-06364-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Hybrid ensemble, an essential branch of ensembles, has flourished in the regression field, with studies confirming diversity's importance. However, previous ensembles consider diversity in the sub-model training stage, with limited improvement compared to single models. In contrast, this study automatically selects and weights sub-models from a heterogeneous model pool. It solves an optimization problem using an interior-point filtering linear-search algorithm. The objective function innovatively incorporates negative correlation learning as a penalty term, with which a diverse model subset can be selected. The best sub-models from each model class are selected to build the NCL ensemble, which performance is better than the simple average and other state-of-the-art weighting methods. It is also possible to improve the NCL ensemble with a regularization term in the objective function. In practice, it is difficult to conclude the optimal sub-model for a dataset prior due to the model uncertainty. Regardless, our method would achieve comparable accuracy as the potential optimal sub-models. In conclusion, the value of this study lies in its ease of use and effectiveness, allowing the hybrid ensemble to embrace diversity and accuracy.
Keyword:
Hybrid ensemble
Diversity
Negative correlation learning
Optimization

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

M
mines paristech
学者数:
1.4K
论文数: 1.1K
被引数: 0
B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
引用论文

引用论文

err分享
err收藏
Risk of second cancer after ion beam radiotherapy: insights from animal carcinogenesis studies
err2019-01-08
err0
PREAI
errTatsuhiko Imaoka; Mayumi Nishimura; Kazuhiro Daino; Masaru Takabatake; Hitomi Moriyama; Yukiko Nishimura; Takamitsu Morioka; Yoshiya Shimada; Shizuko Kakinuma
err分享
err收藏
学者 查看更多内容