arrow
Return

Learning activation rules rather than connection weights

delete2011-11-21
delete0
PRE
AI
E
ERIC L. GRUNDSTROM
J
James A. Reggia
DOI:10.1142/S0129065796000117delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the construction of neural networks involving associative recall, information is sometimes best encoded with a local representation. Moreover, a priori knowledge can lead to a natural selection of connection weights for these networks. With predetermined and fixed weights, standard learning algorithms that work by altering connection strengths are unable to train such networks. To address this problem, this paper derives a supervised learning rule based on gradient descent, where connection weights are fixed and a network is trained by changing the activation rule. It incorporates both traditional and competitive activation mechanisms, the latter being an efficient method for instilling competition in a network. The learning rule has been implemented, and the results from several test networks demonstrate that it works effectively.
Keywords:
NEURAL NETWORKS
MODEL
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Neural Systems cover
International Journal of Neural Systems
IF:
6.4
Papers:
1.2K
Citations:
3.3K

Organization

No organization information available