arrow
Return

A regularized root-quartic mixture of experts for complex classification problems

delete2016-10-01
delete9
PRE
AI
A
Abbasi, Elham
M
Mohammad Ebrahim Shiri *
M
Mehdi Ghatee
DOI:10.1016/j.knosys.2016.07.018delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Mixture of experts is a neural network based ensemble learning approach consisting of several experts and a gating network. In this paper, we introduce regularized root-quartic mixture of experts (R-RTQRT-ME) by incorporating a regularization term into the error function to control the complexity of model and to increase robustness in confronting with over-fitting and noise. The average of the results of R-RTQRT-ME on 20 classification benchmark datasets, shows that this algorithm performs 1.75%, 2.50%, 2.29% better than multi objective regularized negative correlation learning, multi objective negative correlation learning and multi objective neural network, respectively. Also, the average of improvements of R-RTQRT-ME is 1.16%, 2.31%, 3.40%, 3.39% in comparison with root-quartic mixture of experts, mixture of negatively correlated experts, mixture of experts and negative correlation leaming, respectively. Furthermore, the effect of the regularization penalty term in R-RTQRT-ME on noisy data is analyzed which shows the robustness of R-RTQRT-ME in these situations. (C) 2016 Elsevier B.V. All rights reserved.
Keywords:
Mixture of experts
Negative correlation learning
Ensemble learning
Diversity
Generalization ability
Regularization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

A
Amirkabir University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 1.0W
Cited Papers

Cited Papers

errShare
errSave
EROS: Ensemble rough subspaces
err2007-12-01
err89
PREAI
errHu, Qinghua; Yu, Daren; Xie, Zongxia; Li, Xiaodong
errShare
errSave
errShare
errSave
Combining features of negative correlation learning with mixture of experts in proposed ensemble methods
err2012-11-01
err17
PREAI
errMasoudnia, Saeed; Ebrahimpour, Reza; Arani, Seyed Ali Asghar Abbaszadeh
errShare
errSave
PolyI:C suppresses TGF-β1-induced Akt phosphorylation and reduces the motility of A549 lung carcinoma cells
err2021-08-14
err0
errOAAI
errTakahiro Yamaguchi; Teizo Yoshimura; Toshiaki Ohara; Masayoshi Fujisawa; Gao Tong; Akihiro Matsukawa
errShare
errSave
<title>Miniature fiber optic ultrasonic probe</title>
err1996-10-25
err0
errOAAI
errDavid J. Webb; J. Surowiec; M. Sweeney; David A. Jackson; L. R. Gavrilov; J. W. Hand; Lin Zhang; Ian Bennion
errShare
errSave
researcher View more