.png){kind=icon}
返回
Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2010.26.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Negative Correlation Learning (NCL) [1], [2] is a neural network ensemble learning algorithm which introduces a correlation penalty term to the cost function of each individual network so that each neural network minimizes its mean-square-error (MSE) together with the correlation. This paper describes NCL in detail and observes that the NCL corresponds to training the entire ensemble as a single learning machine that only minimizes the MSE without regularization. This insight explains that NCL is prone to overfitting the noise in the training set. The paper analyzes this problem and proposes the multiobjective regularized negative correlation learning (MRNCL) algorithm which incorporates an additional regularization term for the ensemble and uses the evolutionary multiobjective algorithm to design ensembles. In MRNCL, we define the crossover and mutation operators and adopt nondominated sorting algorithm with fitness sharing and rank-based fitness assignment. The experiments on synthetic data as well as real-world data sets demonstrate that MRNCL achieves better performance than NCL, especially when the noise level is nontrivial in the data set. In the experimental discussion, we give three reasons why our algorithm outperforms others.
Keyword:
Multiobjective algorithm
multiobjective learning
neural network ensembles
neural networks
negative correlation learning
regularization
期刊
IF:
10.4
论文数:
6.9K
被引数:
3.2W
机构
引用论文
分享收藏分享收藏Adaptive Impedance Control to Enhance Human Skill on a Haptic Interface System自适应阻抗控制以增强触觉接口系统上的人类技能
OAAI
OAAI分享收藏Evolving hybrid ensembles of learning machines for better generalisation不断发展的学习机器的混合集成，以实现更好的泛化.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
查看更多内容