arrow
Return

A Hub-Based Self-Organizing Algorithm for Feedforward Small-World Neural Network

delete2025-02-01
delete0
PRE
AI
李文静 cover
李文静 (Wenjing Li) *
C
Can Chen
J
Junfei Qiao
DOI:10.1109/TETCI.2024.3451335delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
By integrating the small-world (SW) property into the design of feedforward neural networks, the network performance would be improved by well-documented evidence. To achieve the structural self-adaptation of the feedforward small-world neural networks (FSWNNs), a self-organizing FSWNN, namely SOFSWNN, is proposed based on a hub-based self-organizing algorithm in this paper. Firstly, an FSWNN is constructed according to Watts-Strogatz's rule. Derived from the graph theory, the hub centrality is calculated for each hidden neuron and then used as a measurement for its importance. The self-organizing algorithm is designed by splitting important neurons and merging unimportant neurons with their correlated neurons, and the convergence of this algorithm can be guaranteed theoretically. Extensive experiments are conducted to validate the effectiveness and superiority of SOFSWNN for both classification and regression problems. SOFSWNN achieves an improved generalization performance by SW property and the self-organizing structure. Besides, the hub-based self-organizing algorithm would determine a compact and stable network structure adaptively even from different initial structure.
Keywords:
Feedforward neural networks
small-world property
hub centrality
self-organizing algorithm
self-organizing algorithm
small-world property
hub centrality
self-organizing algorithm

Journal

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
Papers:
1.4K
Citations:
4.5K

Organization

No organization information available