Low-Dimensional Space Modeling-Based Differential Evolution for Large-Scale Global Optimization Problems

Thiago Henrique Lemos Fonseca

doi:10.1109/TEVC.2022.3227440

Low-Dimensional Space Modeling-Based Differential Evolution for Large-Scale Global Optimization Problems

2023-10-01

0

OA

AI

T

Thiago Henrique Lemos Fonseca *

S

Sílvia Modesto Nassar

A

Alexandre Cêsar Muniz de Oliveira

B

Bruno Agard

DOI：10.1109/TEVC.2022.3227440

Original

Original request for help

Save

Abstract

En 中文

Large-scale global optimization (LSGO) has been an active research field. Part of this interest is supported by its application to cutting-edge research, such as Deep Learning, Big Data, and complex real-world problems, such as image encryption, real-time traffic management, and more. However, the high dimensionality makes solving LSGO a significant challenge. Some recent research deal with the high dimensionality by mapping the optimization process to a reduced alternative space. Nonetheless, these works suffer from the changes in the search space topology and the loss of information caused by the dimensionality reduction. This article proposes a hybrid metaheuristic, so-called low-dimensional space modeling-based differential evolution (LSMDE), that uses the singular value decomposition to build a low-dimensional search space from the features of candidate solutions generated by a new SHADE-based algorithm (GM-SHADE). GM-SHADE combines a Gaussian mixture model (GMM) and two specialized local algorithms: 1) MTS-LS1 and 2) L-BFGS-B, to promote a better exploration of the reduced search space. GMM mitigates the loss of information in mapping high-dimensional individuals to low-dimensional individuals. Furthermore, the proposal does not require prior knowledge of the search space topology, which makes it more flexible and adaptable to different LSGO problems. The results indicate that LSMDE is the most efficient method to deal with partially separable functions compared to other state-of-the-art algorithms and has the best overall performance in two of the three proposed experiments. Experimental results also show that the new approach achieves competitive results for nonseparable and overlapping functions on the most recent test suite for LSGO problems.

Keywords:

Differential evolution (DE)

dimensionality reduction

Gaussian mixture model (GMM)

singular value decomposition (SVD)

Low-Dimensional Space Modeling-Based Differential Evolution for Large-Scale Global Optimization Problems

Abstract

Journal

Organization