返回
Deep learning with adaptive learning rate using laplacian score
DOI:10.1016/j.eswa.2016.05.022.png)
摘要
En 中文
An attempt has been made to improve the performance of Deep Learning with Multilayer Perceptron (MLP). Tuning the learning rate or finding an optimum learning rate in MLP is a major challenge. Depending on the value of the learning rate, classification accuracy can vary drastically. This issue has been taken as a challenge in this paper. In this paper, a new approach has been proposed to combine adaptive learning rate in conjunction with the concept of Laplacian score for varying the weights. Learning rate is taken as a function of parameter which itself is updated on the basis of error gradient by forming mini batches. Laplacian score of the neuron is further used for updating the incoming weights. This removes the bottleneck involved in finding the optimum value for the learning rate in Deep Learning by using MLP. It is observed on benchmark datasets that this approach leads to increase in classification accuracy as compared to the existing benchmark levels achieved by the well known methods of deep learning. (C) 2016 Published by Elsevier Ltd.
Keyword:
Adaptive learning rate
Deep learning
Gradient descent
Laplacian score
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
Integration of genetic fuzzy systems and artificial neural networks for stock price forecasting集成遗传模糊系统和人工神经网络的股票价格预测
Histopathology of Ripe Rot Caused byColletotrichum gloeosporioideson Muscadine Grape麝香葡萄 炭疽病菌 引起的成熟腐烂的组织病理学
Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用
PROCEEDINGS OF THE IEEE
IF25.9
Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange使用人工神经网络和支持向量机预测股价指数的运动方向: 伊斯坦布尔证券交易所的样本

