Convergence analysis for sparse Pi-sigma neural network model with entropy error function

doi:10.1007/s13042-023-01901-x

Convergence analysis for sparse Pi-sigma neural network model with entropy error function

2023-07-12

4

PRE

AI

DOI：10.1007/s13042-023-01901-x

Original

Original request for help

Save

Abstract

En 中文

As a high-order neural network, the Pi-sigma neural network has demonstrated its capacities for fast learning and strong nonlinear processing. In this paper, a new algorithm is proposed for Pi-sigma neural networks with entropy error functions based on L-0 regularization. One of the key features of the proposed algorithm is the use of an entropy error function instead of the more common square error function, which is different from those in most existing literature. At the same time, the proposed algorithm also employs L-0 regularization as a means of ensuring the efficiency of the network. Based on the gradient method, the monotonicity, and strong and weak convergence of the network are strictly proved by theoretical analysis and experimental verification. Experiments on applying the proposed algorithm to both classification and regression problems have demonstrated the improved performance of the algorithm.

Keywords:

Pi-sigma neural network

Entropy error function

L-0 Regularization

Convergence

Convergence analysis for sparse Pi-sigma neural network model with entropy error function

Abstract

Journal

Organization