arrow
Return

Forward and backward input variable selection for polynomial echo state networks

delete2020-07-01
delete5
PRE
AI
杨翠丽 cover
杨翠丽 (Cuili Yang)
X
Xinxin Zhu
乔俊飞 cover
乔俊飞 (Junfei Qiao) *
K
Kaizhe Nie
DOI:10.1016/j.neucom.2020.02.034delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As extension of traditional echo state networks (ESNs), the polynomial echo state networks (PESNs) have been proposed in our previous work (Yang et al., 208) by employing the polynomial function of complete input variable as output weight matrix. In practice, the generalization performance and computational burden of PESNs are perturbed by redundant or irrelevant inputs. To construct output weights with a suitable subset of input variables, the forward selection based PESN (FS-PESN) and backward selection based PESN (BS-PESN) are proposed. Firstly, the forward selection method is used in FS-PESN to choose the input variable which incurs the maximum reduction on objective function, and the backward selection shame is introduced in BS-PESN to remove the input variable which leads to the smallest increment on objective function. Then, the iterative updating strategies are designed to avoid repetitive computations in FS-PESN and BS-PESN. Specially, an accelerating scheme is introduced into BS-PESN to simplify training process. Finally, numerical simulations are carried out to illustrate effectiveness of the proposed techniques in terms of generalization ability and testing time. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Polynomial echo state network
Forward selection
Backward selection
Input variable selection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

B
Beijing University of Technology
Scholars:
2.8W
Papers: 2.1W
Citations: 2.7W
Cited Papers

Cited Papers

Cytotoxicity and biological effects of functional nanomaterials delivered to various cell lines
err2009-09-16
err0
PREAI
errMeena Mahmood; Daniel A. Casciano; Teodora Mocan; Cornel Iancu; Yang Xu; Lucian Mocan; Dana Todea Iancu; Enkeleda Dervishi; Zhongrui Li; Mustafa Abdalmuhsen; Alexandru R. Biris; Nawab Ali; Paul Howard; Alexandru S. Biris
errShare
errSave
Modeling collinear data using double-layer GA-based selective ensemble kernel partial least squares algorithm
err2017-01-01
err24
PREAI
errTang, Jian; Zhang, Jian; Wu, Zhiwei; Liu, Zhuo; Chai, Tianyou; Yu, Wen
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Feature selection of generalized extreme learning machine for regression problems
err2018-01-01
err10
PREAI
errZhao, Yong-Ping; Pan, Ying-Ting; Song, Fang-Quan; Sun, Liguo; Chen, Ting-Hao
errShare
errSave
Regression tree ensembles for wind energy and solar radiation prediction
err2019-01-01
err146
PREAI
errTorres-Barran, Alberto; Alonso, Alvaro; Dorronsoro, Jose R.
errShare
errSave
Orthogonal least squares based center selection for fault-tolerant RBF networks
err2019-04-01
err13
PREAI
errDong, Jing; Zhao, Yuxin; Liu, Chang; Han, Zi-Fa; Leung, Chi-Sing
errShare
errSave
errShare
errSave
Constructive algorithm for fully connected cascade feedforward neural networks
err2016-03-01
err42
PREAI
errQiao, Junfei; Li, Fanjun; Han, Honggui; Li, Wenjing
errShare
errSave
researcher View more