arrow
Return

A double-layer ELM with added feature selection ability using a sparse Bayesian approach

delete2016-12-01
delete6
PRE
AI
F
Farkhondeh Kiaee *
C
Christian Gagné
H
Hamid Sheikhzadeh
DOI:10.1016/j.neucom.2016.08.011delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The Sparse Bayesian Extreme Learning Machine (SBELM) has been recently proposed to reduce the number of units activated on the hidden layer. To deal with high-dimensional data, a novel sparse Bayesian Double-Layer ELM (DL-ELM) is proposed in this paper. The first layer of the proposed DL-ELM is based on a set of SBELM subnetworks which are separately applied to the features on the input layer. The second layer consists in a set of weight parameters to determine the contribution of each feature in the output. Adopting a Bayesian approach and using Gaussian priors, the proposed method is sparse in both the hidden layer (of SBELM subnetworks) and the input layer. Sparseness in the input layer (i.e. pruning of irrelevant features) is achieved by decaying weights on the second layer to zero, such that the contribution of the corresponding input feature is deactivated. The proposed framework then enables simultaneous feature selection and classifier design at the training time. Experimental comparisons on real benchmark data sets show that the proposed method benefits from efficient feature selection ability while providing a compact classification model of good accuracy and generalization properties. (C) 2016 Elsevier B.V. All rights reserved.
Keywords:
Extreme learning machine
Feature selection
Sparse Bayesian learning
Subnetwork architecture
Binary classification
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

L
laval university
Scholars:
2.5W
Papers: 2.2W
Citations: 96
A
Amirkabir University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 1.0W