arrow
返回

Training Echo State Networks with Regularization Through Dimensionality Reduction

delete2017-01-13
delete44
PRE
AI
S
Sigurd Løkse
F
Filippo Maria Bianchi *
J
Jenssen, Robert
DOI:10.1007/s12559-017-9450-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we introduce a new framework to train a class of recurrent neural network, called Echo State Network, to predict real valued time-series and to provide a visualization of the modeled system dynamics. The method consists in projecting the output of the internal layer of the network on a lower dimensional space, before training the output layer to learn the target task. Notably, we enforce a regularization constraint that leads to better generalization capabilities. We evaluate the performances of our approach on several benchmark tests, using different techniques to train the readout of the network, achieving superior predictive performance when using the proposed framework. Finally, we provide an insight on the effectiveness of the implemented mechanics through a visualization of the trajectory in the phase space and relying on the methodologies of nonlinear time-series analysis. By applying our method on well-known chaotic systems, we provide evidence that the lower dimensional embedding retains the dynamical properties of the underlying system better than the full-dimensional internal states of the network.
Keyword:
Echo state network
Nonlinear time-series analysis
Dimensionality reduction
Time-series prediction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Cognitive Computation 封面图
Cognitive Computation
IF:
4.3
论文数:
1.6K
被引数:
3.6K

机构

U
uit the arctic university of tromso
学者数:
9.9K
论文数: 8.7K
被引数: 10
引用论文

引用论文

Impairment in emotion perception from body movements in individuals with bipolar I and bipolar II disorder is associated with functional capacity
err2017-05-17
err0
errOAAI
errAnja Vaskinn; Trine Vik Lagerberg; Thomas D. Bjella; Carmen Simonsen; Ole A. Andreassen; Torill Ueland; Kjetil Sundet
err分享
err收藏
Diuretics in Chronic Renal Disease: A Study of High Dosage Frusemide
err1971-09-01
err0
PREAI
errMarjorie E. M. Allison; A. C. Kennedy
err分享
err收藏
Neuropsychiatric adverse drug reactions induced by montelukast impair the quality of life in children with asthma
err2020-12-21
err0
PREAI
errOznur Yilmaz Bayer; Ipek Turktas; Hacer Ilbilge Ertoy Karagol; Sebnem Soysal; Dilek Yapar
err分享
err收藏
err分享
err收藏
Multilayered Echo State Machine: A Novel Architecture and Algorithm
err2017-04-01
err55
errOAAI
errMalik, Zeeshan Khawar; Hussain, Amir; Wu, Qingming Jonathan
err分享
err收藏
An online generalized eigenvalue version of Laplacian Eigenmaps for visual big data
err2016-01-01
err29
errOAAI
errMalik, Zeeshan Khawar; Hussain, Amir; Wu, Jonathan
err分享
err收藏
Interleukin-18 secretion and Th1-like cytokine responses in human peripheral blood mononuclear cells under the influence of the toll-like receptor-5 ligand flagellin
err2006-02-01
err0
errOAAI
errMalte Bachmann; Katharina Horn; Marco A. Poleganov; Jens Paulukat; Marcel Nold; Josef Pfeilschifter; Heiko Muhl
err分享
err收藏
学者 查看更多内容