arrow
Return

The Hebbian-LMS Learning Algorithm

delete2015-11-01
delete20
PRE
AI
B
Bernard Widrow *
Y
Young Sik Kim
D
Dookun Park
DOI:10.1109/MCI.2015.2471216delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Hebbian learning is widely accepted in the fields of psychology, neurology, and neurobiology. It is one of the fundamental premises of neuroscience. The LMS (least mean square) algorithm of Widrow and Hoff is the world's most widely used adaptive algorithm, fundamental in the fields of signal processing, control systems, pattern recognition, and artificial neural networks. These are very different learning paradigms. Hebbian learning is unsupervised. LMS learning is supervised. However, a form of LMS can be constructed to perform unsupervised learning and, as such, LMS can be used in a natural way to implement Hebbian learning. Combining the two paradigms creates a new unsupervised learning algorithm that has practical engineering applications and provides insight into learning in living neural networks. A fundamental question is, how does learning take place in living neural networks? Nature's little secret, the learning algorithm practiced by nature at the neuron and synapse level, may well be the Hebbian-LMS algorithm.
Keywords:
EQUALIZATION
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Computational Intelligence Magazine cover
IEEE Computational Intelligence Magazine
IF:
11.2
Papers:
606
Citations:
3.1K

Organization

S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W