Random vector functional link neural network based ensemble deep learning

Qiushi Shi

doi:10.1016/j.patcog.2021.107978

Return

Random vector functional link neural network based ensemble deep learning

2021-09-01

158

Qiushi Shi

Rakesh Katuwal

Ponnuthurai Nagaratnam Suganthan *

M. Tanveer

DOI：10.1016/j.patcog.2021.107978

Original

Save

View PDF

Abstract

En 中文

In this paper, we propose deep learning frameworks based on the randomized neural network. Inspired by the principles of Random Vector Functional Link (RVFL) network, we present a deep RVFL network (dRVFL) with stacked layers. The parameters of the hidden layers of the dRVFL are randomly generated within a suitable range and kept fixed while the output weights are computed using the closed-form solution as in a standard RVFL network. We also propose an ensemble deep network (edRVFL) that can be regarded as a marriage of ensemble learning with deep learning. Unlike traditional ensembling approaches that require training several models independently from scratch, edRVFL is obtained by training a single dRVFL network once. Both dRVFL and edRVFL frameworks are generic and can be used with any RVFL variant. To illustrate this, we integrate the deep learning RVFL networks with a recently proposed sparse pre-trained RVFL (SP-RVFL). Experiments on 46 tabular UCI classification datasets and 12 sparse datasets demonstrate that the proposed deep RVFL networks outperform state-of-the-art deep feed-forward neural networks (FNNs). (c) 2021 Elsevier Ltd. All rights reserved.

Keywords:

Random Vector Functional Link (RVFL)

Deep RVFL

Multi-layer RVFL

Ensemble deep learning

Randomized neural network

Extreme learning machine (ELM)

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.