arrow
Return

Boosted multilayer feedforward neural network with multiple output layers

delete2024-12-01
delete0
PRE
AI
H
Hussein Aly *
A
Abdulaziz Al‐Ali
P
Ponnuthurai Nagaratnam Suganthan
DOI:10.1016/j.patcog.2024.110740delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This research introduces the Boosted Ensemble deep Multi-Layer Layer Perceptron (EdMLP) architecture with multiple output layers, a novel enhancement for the traditional Multi-Layer Perceptron (MLP). By adopting a layer-wise training approach, EdMLP enables the integration of boosting techniques within a single model, treating each layer as a weak learner, resulting in substantial performance gains. Additionally, the inclusion of layer-wise hyperparameter tuning allows optimization of individual layers thereby reducing the tuning time. Furthermore, the ensemble deep architecture's versatility can be extended to other neural network-based models, such as the Self Normalized Network (SNN) where experiments demonstrate substantial performance enhancements yielded by the EdSNN compared to the standard original SNN model. This research underscores the potential of the EdMLP, and the Ed architecture in general as a powerful tool for improving the performance of various multilayer feedforward neural network models. The source code of this work is publicly accessible from the authors GitHub.
Keywords:
Multiple output layers
Layer-wise training
Boosting
Ensemble classifier
Tabular data classification

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

Q
Qatar University
Scholars:
8.9K
Papers: 9.0K
Citations: 16