Return
A neural network with strong interpretability for solving optimization problems
DOI:10.1016/j.asoc.2024.112688.png)
Abstract
En 中文
Accurate and rapid solutions to optimization problems are crucial in scientific and engineering fields. To address diverse optimization challenges, this paper proposes an Optimization Problem Solving Network (OPSN), a novel neural network with strong interpretability. By introducing the Lagrange multiplier method and Karush-Kuhn-Tucker (KKT) conditions, the theoretical conditions that must be satisfied to obtain the optimal solution are derived. Based on these conditions, OPSN is developed. The network structure of OPSN is similar to that of the backpropagation (BP) neural network; however, the forward computation formula is redesigned to incorporate the constraint information inherent in the optimization problem. By introducing the penalty coefficient, the activation functions of the network nodes are redefined to assess whether the constraints are satisfied. Additionally, a special node is added to capture information about the objective function. To reduce the adjustable parameters, the network input is fixed at 1, and the normalization algorithm has been developed based on the search range of each variable. The network is initialized with random weights as starting values. Extensive testing on 15 CEC2017 benchmark functions and six real-world engineering problems demonstrates OPSN's superior performance, faster convergence, and broad applicability compared to five established optimization algorithms.
Keywords:
Optimization problem
OPSN
Metaheuristic
Optimization problem solving network
Journal
IF:
6.6
Papers:
1.4W
Citations:
4.8W

