arrow
返回

Back-propagation is not efficient

delete1996-08-01
delete24
PRE
AI
J
Jiřı́ Šı́ma *
DOI:10.1016/0893-6080(95)00135-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The back-propagation learning algorithm for multi-layered neural networks, which is often successfully used in practice, appears very time consuming even for small network architectures or training tasks. However, no results are yet known concerning the complexity of this algorithm. Blum and Rivest proved that training even a three-node network is NP-complete for the case when a neuron computes the discrete linear threshold function. We generalize the technique from their NP-hardness proof for a continuous sigmoidal function used in back-propagation. We show that training a three-node sigmoid network with an additional constraint on the output neuron function (e.g., zero threshold) is NP-hard. As a consequence of this, we find training sigmoid feedforward networks, with a single hidden layer and with zero threshold of output neuron, to be intractable. This implies that back-propagation is generally not an efficient algorithm, unless at least P = NP. We rake advantage of these results by showing the NP-hardness of a special nonlinear programming problem. Copyright (C) 1996 Elsevier Science Ltd.
Keyword:
learning theory
loading problem
NP-hardness
standard sigmoid function
back-propagation
nonlinear programming
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.3K
被引数:
3.0W

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Effect of convection on the microstructure of the MnBi/Bi eutectic
err1986-10-01
err0
PREAI
errGaber Faheem Eisa; William R. Wilcox; Garrett Busch
err分享
err收藏
Comparison of native and non-native ubiquitin oligomers reveals analogous structures and reactivities
err2016-01-12
err0
errOAAI
errGrace H. Pham; Ambar S. J. B. Rana; E. Nihal Korkmaz; Vivian H. Trang; Qiang Cui; Eric R. Strieter
err分享
err收藏
学者 查看更多内容