返回
A hybrid ensemble method with negative correlation learning for regression
DOI:10.1007/s10994-023-06364-3.png)
摘要
En 中文
Hybrid ensemble, an essential branch of ensembles, has flourished in the regression field, with studies confirming diversity's importance. However, previous ensembles consider diversity in the sub-model training stage, with limited improvement compared to single models. In contrast, this study automatically selects and weights sub-models from a heterogeneous model pool. It solves an optimization problem using an interior-point filtering linear-search algorithm. The objective function innovatively incorporates negative correlation learning as a penalty term, with which a diverse model subset can be selected. The best sub-models from each model class are selected to build the NCL ensemble, which performance is better than the simple average and other state-of-the-art weighting methods. It is also possible to improve the NCL ensemble with a regularization term in the objective function. In practice, it is difficult to conclude the optimal sub-model for a dataset prior due to the model uncertainty. Regardless, our method would achieve comparable accuracy as the potential optimal sub-models. In conclusion, the value of this study lies in its ease of use and effectiveness, allowing the hybrid ensemble to embrace diversity and accuracy.
Keyword:
Hybrid ensemble
Diversity
Negative correlation learning
Optimization
期刊
IF:
2.9
论文数:
2.7K
被引数:
3.4W
机构
引用论文
Anastomotic Leakage Using Linear Stapling Device with Pre-attached Bioabsorbable Polyglycolic Acid Felt After Laparoscopic Anterior Resection腹腔镜前切除术后使用带有预附着生物可吸收聚乙醇酸毡的线性吻合装置的吻合口漏
Negative correlation learning-based RELM ensemble model integrated with OVMD for multi-step ahead wind speed forecasting基于负相关学习的RELM集成模型与OVMD集成,用于多步前进风速预测
RENEWABLE ENERGY
IF9.1
Evolving hybrid ensembles of learning machines for better generalisation不断发展的学习机器的混合集成,以实现更好的泛化
NEUROCOMPUTING
IF6.5

