.png){kind=icon}
返回
SGD method for entropy error function with smoothing l0 regularization for neural networks
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-024-05564-1.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The entropy error function has been widely used in neural networks. Nevertheless, the network training based on this error function generally leads to a slow convergence rate, and can easily be trapped in a local minimum or even with the incorrect saturation problem in practice. In fact, there are many results based on entropy error function in neural network and its applications. However, the theory of such an algorithm and its convergence have not been fully studied so far. To tackle the issue, this works proposes a novel entropy function with smoothing l(0) regularization for feed-forward neural networks. An empirical evaluation has been conducted on real-world datasets to demonstrate that the newly conceived algorithm allows us to substantially improve the prediction performance of the considered neural networks. More importantly, the experimental results also show that the proposed function brings in more precise classifications, compared to well-founded baselines. The work is novel as it enables neural networks to learn effectively, producing more accurate predictions compared to state-of-the-art algorithms. In this respect, it is expected that the algorithm will contribute to existing studies in the field, advancing research in Machine Learning and Deep Learning.
Keyword:
Neural networks
l0 regularization
Entropy function
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Improved anti-noise adaptive long short-term memory neural network modeling for the robust remaining useful life prediction of lithium-ion batteries改进抗噪声自适应长短期记忆神经网络建模的锂离子电池鲁棒剩余寿命预测
OAAI
OAAI分享收藏Smooth group L1/2 regularization for input layer of feedforward neural networks.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏分享收藏Spike-driven multi-scale learning with hybrid mechanisms of spiking dendritesNEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
查看更多内容