arrow
Return

Pruning and regularization in reservoir computing

delete2009-03-01
delete95
PRE
AI
X
Xavier Dutoit *
B
Benjamin Schrauwen
J
Jan Van Campenhout
D
Dirk Stroobandt
H
H. Van Brussel
M
Marnix Nuttin
DOI:10.1016/j.neucom.2008.12.020delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Reservoir computing is a new paradigm for using recurrent neural network with a much simpler training method. The key idea is to use a large but fixed recurrent part as a reservoir of dynamic features and to train only the output layer to extract the desired information. We propose to study how pruning some connections from the reservoir to the output layer can help on the one hand to increase the generalization ability, in much the same way as regularization techniques do, and on the other hand to improve the implementability of reservoirs in hardware. (C) 2009 Elsevier B.V. All rights reserved.
Keywords:
Reservoir computing
Echo state network
Variable selection
Regularization
Ridge regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

G
Ghent University
Scholars:
5.2W
Papers: 4.5W
Citations: 5.5W
K
KU Leuven
Scholars:
5.7W
Papers: 5.2W
Citations: 8.1W