.png){kind=icon}
返回
Parallel Training Considered Harmful?: Comparing series-parallel and parallel feedforward network training
.png){kind=icon}
OA
AI
DOI：10.1016/j.neucom.2018.07.071.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Neural network models for dynamic systems can be trained either in parallel or in series-parallel configurations. Influenced by early arguments, several papers justify the choice of series-parallel rather than parallel configuration claiming it has a lower computational cost, better stability properties during training and provides more accurate results. Other published results, on the other hand, defend parallel training as being more robust and capable of yielding more accurate long-term predictions. The main contribution of this paper is to present a study comparing both methods under the same unified framework with special attention to three aspects: (i) robustness of the estimation in the presence of noise; (ii) computational cost; and, (iii) convergence. A unifying mathematical framework and simulation studies show situations where each training method provides superior validation results and suggest that parallel training is generally better in more realistic scenarios. An example using measured data seems to reinforce such a claim. Complexity analysis and numerical examples show that both methods have similar computational cost although series-parallel training is more amenable to parallelization. Some informal discussion about stability and convergence properties is presented and explored in the examples. (C) 2018 Elsevier B.V. All rights reserved.
Keyword:
Neural network
Parallel training
Series-parallel training
System identification
Output error models
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
.png){kind=icon}
分享收藏分享收藏Investigation on the Dielectric Properties of 0–3 Lead Zirconate Titanate-Geopolymer Composites
PREAI
分享收藏分享收藏Cross-linkable Polymer Matrix for Enhanced Thermal Stability of Succinonitrile-based Polymer Electrolyte in Lithium Rechargeable Batteries可交联聚合物基质，用于增强锂可充电电池中基于丁二腈的聚合物电解质的热稳定性
OAAI
OAAI分享收藏
查看更多内容