返回
Hardware-friendly Higher-Order Neural Network Training using Distributed Evolutionary Algorithms
DOI:10.1016/j.asoc.2009.08.010.png)
摘要
En 中文
In this paper, we study the class of Higher-Order Neural Networks and especially the Pi-Sigma Networks. The performance of Pi-Sigma Networks is evaluated through several well known Neural Network Training benchmarks. In the experiments reported here, Distributed Evolutionary Algorithms are implemented for Pi-Sigma neural networks training. More specifically the distributed versions of the Differential Evolution and the Particle Swarm Optimization algorithms have been employed. To this end, each processor is assigned a subpopulation of potential solutions. The subpopulations are independently evolved in parallel and occasional migration is employed to allow cooperation between them. The proposed approach is applied to train Pi-Sigma Networks using threshold activation functions. Moreover, the weights and biases were confined to a narrow band of integers, constrained in the range [-32; 32]. Thus, the trained Pi-Sigma neural networks can be represented by using 6 bits. Such networks are better suited than the real weight ones for hardware implementation and to some extend are immune to low amplitude noise that possibly contaminates the training data. Experimental results suggest that the proposed training process is fast, stable and reliable and the distributed trained Pi-Sigma Networks exhibited good generalization capabilities. (C) 2009 Elsevier B.V. All rights reserved.
Keyword:
Pi-Sigma Networks
Distributed Differential Evolution
Distributed Particle Swarm Optimization
Back-propagation Neural Networks
Integer Weight Neural Networks
Threshold activation functions
Hardware-Friendly'' Implementations
'On-chip' training
Higher-Order Neural Networks
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.6
论文数:
1.4W
被引数:
4.8W
机构
引用论文
Universal and group‐specific real‐time PCR diagnosis of flavescence dorée (16Sr‐V), bois noir (16Sr‐XII) and apple proliferation (16Sr‐X) phytoplasmas from field‐collected plant hosts and insect vectors从野外收集的植物寄主和昆虫载体中发现的食用香料 (16Sr ‐ v),bois noir (16Sr ‐ xii) 和苹果增殖 (16Sr ‐ x) 植原体的通用和群体特异性实时PCR诊断
Transcriptomic and Expression Analysis of the Salivary Glands in White-Backed Planthoppers, Sogatella furcifera
PLOS ONE
IF0
Effect of gibberellic acid treatments, environmental conditions, and genetic background on the expression of theparthenocarpic fruit mutation in tomato赤霉素处理,环境条件和遗传背景对番茄单性结实果实突变表达的影响
Protoplasma
IF0

