arrow
返回

Hardware-friendly Higher-Order Neural Network Training using Distributed Evolutionary Algorithms

delete2010-03-01
delete25
PRE
AI
M
Michael G. Epitropakis
V
Vassilis P. Plagianakos
M
Michael N. Vrahatis *
DOI:10.1016/j.asoc.2009.08.010delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we study the class of Higher-Order Neural Networks and especially the Pi-Sigma Networks. The performance of Pi-Sigma Networks is evaluated through several well known Neural Network Training benchmarks. In the experiments reported here, Distributed Evolutionary Algorithms are implemented for Pi-Sigma neural networks training. More specifically the distributed versions of the Differential Evolution and the Particle Swarm Optimization algorithms have been employed. To this end, each processor is assigned a subpopulation of potential solutions. The subpopulations are independently evolved in parallel and occasional migration is employed to allow cooperation between them. The proposed approach is applied to train Pi-Sigma Networks using threshold activation functions. Moreover, the weights and biases were confined to a narrow band of integers, constrained in the range [-32; 32]. Thus, the trained Pi-Sigma neural networks can be represented by using 6 bits. Such networks are better suited than the real weight ones for hardware implementation and to some extend are immune to low amplitude noise that possibly contaminates the training data. Experimental results suggest that the proposed training process is fast, stable and reliable and the distributed trained Pi-Sigma Networks exhibited good generalization capabilities. (C) 2009 Elsevier B.V. All rights reserved.
Keyword:
Pi-Sigma Networks
Distributed Differential Evolution
Distributed Particle Swarm Optimization
Back-propagation Neural Networks
Integer Weight Neural Networks
Threshold activation functions
Hardware-Friendly'' Implementations
'On-chip' training
Higher-Order Neural Networks
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

U
university of central greece
学者数:
27
论文数: 41
被引数: 0
U
University of Patras
学者数:
1.2W
论文数: 9.6K
被引数: 8.4K
引用论文

引用论文

Insect vectors of plant pathogenic Mollicutes in the Euro-Mediterranean region
err2015-01-01
err0
PREAI
errAlberto Alma; Rosemarie Tedeschi; Federico Lessio; Luca Picciau; Elena Gonella; Chiara Ferracini
err分享
err收藏
Recurrent pi-sigma networks for DPCM image coding
err2003-09-01
err33
PREAI
errHussain, AJ; Liatsis, P
err分享
err收藏
A Soft Chemistry Approach to Coating of LiFePO4 with a Conducting Polymer
err2011-06-10
err0
errOAAI
errDavid Lepage; Christophe Michot; Guoxian Liang; Michel Gauthier; Steen B. Schougaard
err分享
err收藏
err1997-01-01
err0
PREAI
errRainer Storn; Kenneth Price
err分享
err收藏
学者 查看更多内容