arrow
Return

Assessing ranking and effectiveness of evolutionary algorithm hyperparameters using global sensitivity analysis methodologies

delete2022-10-01
delete9
delete
OA
AI
V
Varun Ojha *
J
Jon Timmis
G
Giuseppe Nicosia
DOI:10.1016/j.swevo.2022.101130delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We present a comprehensive global sensitivity analysis of two single-objective and two multi-objective state-of-the-art global optimization evolutionary algorithms as an algorithm configuration problem. That is, we investigate the quality of influence hyperparameters have on the performance of algorithms in terms of their direct effect and interaction effect with other hyperparameters. Using three sensitivity analysis methods, Morris LHS, Morris, and Sobol, to systematically analyze tunable hyperparameters of covariance matrix adaptation evolutionary strategy, differential evolution, non-dominated sorting genetic algorithm III, and multi-objective evolutionary algorithm based on decomposition, the framework reveals the behaviors of hyperparameters to sampling methods and performance metrics. That is, it answers questions like what are hyperparameters influence patterns, how they interact, how much they interact, and how much their direct influence is. Consequently, the ranking of hyper -parameters suggests their order of tuning, and the pattern of influence reveals the stability of the algorithms.
Keywords:
Hyperparameter optimization
Evolutionary algorithms
Global sensitivity analysis
Algorithm design
Algorithm stability analysis
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Swarm and Evolutionary Computation cover
Swarm and Evolutionary Computation
IF:
8.5
Papers:
2.1K
Citations:
1.0W

Organization

U
University of Catania
Scholars:
1.9W
Papers: 1.4W
Citations: 20
U
University of Sunderland
Scholars:
670
Papers: 620
Citations: 662
U
University of Reading
Scholars:
1.0W
Papers: 1.1W
Citations: 1.7W
researcher View more organizations