arrow
Return

A neural network with strong interpretability for solving optimization problems

delete2025-02-01
delete0
PRE
AI
J
Jianhan Fan
Y
Yiming Liao
J
Jianxiao Zou *
K
Kaiji Liao
S
Shicai Fan
DOI:10.1016/j.asoc.2024.112688delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Accurate and rapid solutions to optimization problems are crucial in scientific and engineering fields. To address diverse optimization challenges, this paper proposes an Optimization Problem Solving Network (OPSN), a novel neural network with strong interpretability. By introducing the Lagrange multiplier method and Karush-Kuhn-Tucker (KKT) conditions, the theoretical conditions that must be satisfied to obtain the optimal solution are derived. Based on these conditions, OPSN is developed. The network structure of OPSN is similar to that of the backpropagation (BP) neural network; however, the forward computation formula is redesigned to incorporate the constraint information inherent in the optimization problem. By introducing the penalty coefficient, the activation functions of the network nodes are redefined to assess whether the constraints are satisfied. Additionally, a special node is added to capture information about the objective function. To reduce the adjustable parameters, the network input is fixed at 1, and the normalization algorithm has been developed based on the search range of each variable. The network is initialized with random weights as starting values. Extensive testing on 15 CEC2017 benchmark functions and six real-world engineering problems demonstrates OPSN's superior performance, faster convergence, and broad applicability compared to five established optimization algorithms.
Keywords:
Optimization problem
OPSN
Metaheuristic
Optimization problem solving network

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

S
state grid sichuan elect power co
Scholars:
35
Papers: 13
Citations: 3
U
University of Electronic Science and Technology of China
Scholars:
5.5K
Papers: 2.2K
Citations: 4.0W