.png){kind=icon}
返回
Distributed Reservoir Computing with Sparse Readouts
.png){kind=icon}
OA
AI
DOI：10.1109/MCI.2016.2601759.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In a network of agents, a widespread problem is the need to estimate a common underlying function starting from locally distributed measurements. Real-world scenarios may not allow the presence of centralized fusion centers, requiring the development of distributed, message-passing implementations of the standard machine learning training algorithms. In this paper, we are concerned with the distributed training of a particular class of recurrent neural networks, namely echo state networks ( ESNs). In the centralized case, ESNs have received considerable attention, due to the fact that they can be trained with standard linear regression routines. Based on this observation, in our previous work we have introduced a decentralized algorithm, framed in the distributed optimization field, in order to train an ESN. In this paper, we focus on an additional sparsity property of the output layer of ESNs, allowing for very efficient implementations of the resulting networks. In order to evaluate the proposed algorithm, we test it on two well-known-prediction benchmarks, namely the Mackey-Glass chaotic time series and the 10th order nonlinear auto regressive moving average ( NARMA) system. [GRAPHICS] .
Keyword:
VARIABLE SELECTION
OPTIMIZATION
CONSENSUS
NETWORKS
MACHINE
SQUARES
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
11.2
论文数:
613
被引数:
3.1K
机构
引用论文
A generalized LSTM-like training algorithm for second-order recurrent neural networks二阶递归神经网络的广义类LSTM训练算法.png)
NEURAL NETWORKSOAAI
NEURAL NETWORKSIF6.3
OAAI分享收藏
查看更多内容