1
Return

Graph Regularization for High Order Neural Networks: Boundedness, Convergence, and Enhanced Performance With Entropy Error Function [Research Frontier]

delete2026-04-09
delete0
PRE
AI
范钦伟 cover
范钦伟 (Qinwei Fan)
Q
Qianru Huang
J
Jacek M. Żurada
J
Jigen Peng
H
Haiyang Li
DOI:10.1109/MCI.2026.3655677delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As a kind of high order neural network, Sigma-Pi-Sigma has strong nonlinear mapping ability, but the complexity of its network structure often leads to low application efficiency and lack of theoretical results. Although traditional regularization methods are more effective in sparsity and preventing overfitting, they do not take into account the topology and connection information between the data. Therefore, in order to sparsely optimize the network structure for improved efficiency and to enable rigorous theoretical analysis of complex inter-node relationships, graph-structured data must be processed more effectively. In this paper, the graph regularization component is integrated into the Sigma-Pi-Sigma neural network (SPSNN) learning framework, and the SPSNN online gradient algorithm based on the Turlaplacian regularization is studied, considering the entropy error measure. Under reasonable conditions, the boundedness of the weights, the monotonicity of the error function, and the convergence of the algorithm are strictly proved. Subsequently, the effectiveness of this method is verified through extensive experimental data. The simulation results are in good agreement with the theoretical results.
Keywords:
Neural networks
Graphical models
Classification algorithms
Biological neural networks
Accuracy
Entropy
Laplace equations
Toxicology
Stability analysis
Overfitting
Artificial intelligence
Training data
Computational complexity

Journal

IEEE Computational Intelligence Magazine cover
IEEE Computational Intelligence Magazine
IF:
11.2
Papers:
606
Citations:
3.1K

Organization

X
xi'an polytechnic university
Scholars:
945
Papers: 287
Citations: 0
G
Guangzhou University
Scholars:
1.7W
Papers: 1.2W
Citations: 1.8W
U
university of louisville
Scholars:
1.8K
Papers: 731
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers