.png){kind=icon}
返回
Adaptive natural gradient learning algorithms for various stochastic models
.png){kind=icon}
PRE
AI
DOI：10.1016/S0893-6080(00)00051-4.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The natural gradient method has an ideal dynamic behavior which resolves the slow learning speed of the standard gradient descent method caused by plateaus. However, it is required to calculate the Fisher information matrix and its inverse, which makes the implementation of the natural gradient almost impossible. To solve this problem, a preliminary study has been proposed concerning an adaptive method of calculating an estimate of the inverse of the Fisher information matrix, which is called the adaptive natural gradient learning method. In this paper, we show that the adaptive natural gradient method can be extended to be applicable to a wide class of stochastic models: regression with an arbitrary noise model and classification with an arbitrary number of classes. We give explicit forms of the adaptive natural gradient for these models. We confirm the practical advantage of the proposed algorithms through computational experiments on benchmark problems. (C) 2000 Elsevier Science Ltd. All rights reserved.
Keyword:
feedforward neural network
gradient descent learning
plateau problem
natural gradient learning
adaptive natural gradient learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.3
论文数:
7.8K
被引数:
3.0W
机构
暂无机构信息
引用论文
New method for assessing cardiac parasympathetic activity using 24 hour electrocardiograms..png)
Heart
OAAI
HeartIF0
OAAI分享收藏 没有更多内容
没有更多内容