arrow
返回

Enhancing performance of the backpropagation algorithm via sparse response regularization

delete2015-04-01
delete16
PRE
AI
J
Jiangshe Zhang
N
Nannan Ji *
刘军民 封面图
刘军民 (Junmin Liu)
孟德宇 封面图
孟德宇 (Deyu Meng)
DOI:10.1016/j.neucom.2014.11.055delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The backpropagation (BP) algorithm is the most commonly utilized training strategy for a feed-forward artificial neural network (FFANN). The BP algorithm, however, always leads to the problems of low convergence rate, high energy and poor generalization capability of FFANN. In this paper, motivated by the sparsity property of human neuron' responses, we introduce a new sparse-response BP (SRBP) to improve the capacity of a FFANN by enforcing sparsity to its hidden units through imposing a supplemental L-1 term on them. The FFANN model learned from our algorithm is closely related to the real human and thus its mechanism fully complies with the human nervous system, i.e., sparse representation and architectural depth. Experiments on several datasets demonstrate that SRBP yields good performances on convergence rate, energy saving and generalization capability. (C) 2014 Elsevier B.V. All rights reserved.
Keyword:
Feed-forward artificial neural network
Backpropagation
Human nervous system
Regularization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
C
china electronics technology group
学者数:
1.8K
论文数: 1.4K
被引数: 0
引用论文

引用论文

High efficacy of anti DBL4ɛ-VAR2CSA antibodies in inhibition of CSA-binding Plasmodium falciparum-infected erythrocytes from pregnant women
err2011-01-01
err0
PREAI
errPamela A. Magistrado; Daniel Minja; Justin Doritchamou; Nicaise Tuikue Ndam; Davis John; Christentze Schmiegelow; Achille Massougbodji; Madeleine Dahlbäck; Sisse B. Ditlev; Vera V. Pinto; Mafalda Resende; John Lusingu; Thor G. Theander; Ali Salanti; Morten A. Nielsen
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Comparing machines and humans on a visual categorization test
err2011-10-17
err84
errOAAI
errFleuret, Francois; Li, Ting; Dubout, Charles; Wampler, Emma K.; Yantis, Steven; Geman, Donald
err分享
err收藏
err分享
err收藏
学者 查看更多内容