arrow
Return

Back-propagation algorithm with variable adaptive momentum

delete2016-12-01
delete78
PRE
AI
A
Alaa Ali Hameed *
B
Bekir Karlık
M
Mohammad Salman
DOI:10.1016/j.knosys.2016.10.001delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose a novel machine learning classifier by deriving a new adaptive momentum back-propagation (BP) artificial neural networks algorithm. The proposed algorithm is a modified version of the BP algorithm to improve its convergence behavior in both sides, accelerate the convergence process for accessing the optimum steady-state and minimizing the error misadjustment to improve the recognized patterns superiorly. This algorithm is controlled by the learning rate parameter which is dependent on the eigenvalues of the autocorrelation matrix of the input. It provides low error performance for the weights update. To discuss the performance measures of this proposed algorithm and the other supervised learning algorithms such as k-nearest neighbours (k-NN), Naive Bayes (NB), linear discriminant analysis (LDA), support vector machines (SVM), BP, and BP with adaptive momentum (PBPAM) have been compared in term of speed of convergence, Sum of Squared Error (SSE), and accuracy by implementing benchmark problem - XOR and seven datasets from UCI repository. (C) 2016 Elsevier B.V. All rights reserved.
Keywords:
Adaptive momentum
Back-propagation
Supervised learning
Neural network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

S
Selcuk University
Scholars:
4.5K
Papers: 4.4K
Citations: 53
Beykent University cover
Beykent University
Scholars:
335
Papers: 382
Citations: 219
A
American University of the Middle East
Scholars:
1.5K
Papers: 1.6K
Citations: 1
researcher View more organizations