arrow
返回

Choice of benchmark optimization problems does matter

delete2023-12-01
delete6
PRE
AI
A
A. Piotrowski *
J
Jarosław J. Napiórkowski
A
Agnieszka E. Piotrowska
DOI:10.1016/j.swevo.2023.101378delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Various benchmark sets have already been proposed to facilitate comparison between metaheuristics, or Evolutionary Algorithms. During the competition, typically algorithms are allowed either to run until the allowed number of function calls is exhausted (and one compares the quality of solutions found), or until a required objective function value is obtained (one compares the speed in reaching the required solution). During the last 20 years several problem sets were defined using the first approach. In this study, we test 73 optimization algorithms proposed between the 1960 & PRIME;s and 2022 on nine competitions based on four sets of problems (CEC 2011, CEC 2014, CEC 2017, and CEC 2020) with different dimensionalities. We intend to test the original versions of 73 algorithms as they are, with control parameters proposed by the authors of the particular method. The recent benchmark set, CEC 2020, includes fewer problems and allows much more function calls than the former sets. As a result, one group of algorithms perform best on older, a different one on the more recent (CEC 2020) benchmark sets. Almost all algorithms that perform best on CEC 2020 set achieve moderate -to-poor performance on older sets, including real-world problems from CEC 2011. Algorithms that perform best on older sets are more flexible than those that perform best on CEC 2020 benchmark. The choice of the benchmark may have a crucial impact on the final ranking of algorithms. The lack of tuning may affect the results that were obtained in this study, hence it is highly recommended to repeat a similar large-scale comparison with control parameters of each algorithm tuned, best by different methods, separately for each benchmark set.
Keyword:
Evolutionary algorithms
Swarm intelligence
Metaheuristics
Benchmarking
Differential evolution
Particle swarm optimization

期刊

Swarm and Evolutionary Computation 封面图
Swarm and Evolutionary Computation
IF:
8.5
论文数:
2.2K
被引数:
1.0W

机构

I
institute of geophysics of the polish academy of sciences
学者数:
232
论文数: 198
被引数: 0
P
Polish Academy of Sciences
学者数:
3.0W
论文数: 3.1W
被引数: 3.1W
引用论文

引用论文

A Tutorial On the design, experimentation and application of metaheuristic algorithms to real-World optimization problems关于元启发式算法在现实世界优化问题中的设计,实验和应用的教程
err2021-07-01
err218
PREAI
errOsaba, Eneko; Villar-Rodriguez, Esther; Del Ser, Javier; Nebro, Antonio J.; Molina, Daniel; LaTorre, Antonio; Suganthan, Ponnuthurai N.; Coello, Carlos A. Coello; Herrera, Francisco
err分享
err收藏
Metaheuristics: a comprehensive overview and classification along with bibliometric analysis
err2021-03-16
err148
PREAI
errEzugwu, Absalom E.; Shukla, Amit K.; Nath, Rahul; Akinyelu, Andronicus A.; Agushaka, Jeffery O.; Chiroma, Haruna; Muhuri, Pranab K.
err分享
err收藏
Topologies and performance of intelligent algorithms: a comprehensive review
err2016-09-20
err53
PREAI
errNabaei, Armin; Hamian, Melika; Parsaei, Mohammad Reza; Safdari, Reza; Samad-Soltani, Taha; Zarrabi, Houman; Ghassemi, A.
err分享
err收藏
err分享
err收藏
学者 查看更多内容