arrow
返回

Benchmarking Feature-Based Algorithm Selection Systems for Black-Box Numerical Optimization

delete2022-12-01
delete7
delete
OA
AI
R
Ryoji Tanabe *
DOI:10.1109/TEVC.2022.3169770delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently received attention in the research field of black-box numerical optimization. However, there is still room for the analysis of algorithm selection for black-box optimization. Most previous studies have focused only on whether an algorithm selection system can outperform the single-best solver (SBS) in a portfolio. In addition, a benchmarking methodology for algorithm selection systems has not been well investigated in the literature. In this context, this article analyzes algorithm selection systems on the 24 noiseless black-box optimization benchmarking functions. First, we demonstrate that the first successful performance measure is more reliable than the expected runtime measure for benchmarking algorithm selection systems. Then, we examine the influence of randomness on the performance of algorithm selection systems. We also show that the performance of algorithm selection systems can be significantly improved by using sequential least squares programming as a presolver. We point out that the difficulty of outperforming the SBS depends on algorithm portfolios, cross-validation methods, and dimensions. Finally, we demonstrate that the effectiveness of algorithm portfolios depends on various factors. These findings provide fundamental insights for algorithm selection for black-box optimization.
Keyword:
Bechmarking
black-box numerical optimization
feature-based algorithm selection

期刊

IEEE Transactions on Evolutionary Computation 封面图
IEEE Transactions on Evolutionary Computation
IF:
12
论文数:
1.8K
被引数:
2.4W

机构

Y
Yokohama National University
学者数:
4.2K
论文数: 3.4K
被引数: 3.2K
引用论文

引用论文

Cellular Renewal and Improvement of Local Cell Effector Activity in Peritoneal Cavity in Response to Infectious Stimuli
err2011-07-22
err0
errOAAI
errAlexandra dos Anjos Cassado; José Antônio Tavares de Albuquerque; Luiz Roberto Sardinha; Carina de Lima Buzzo; Lucas Faustino; Rogério Nascimento; Eliver Eid Bou Ghosn; Maria Regina D'Império Lima; Jose Maria Mosig Alvarez; Karina Ramalho Bortoluci
err分享
err收藏
Metabolic plasticity in the hygrophyte Moringa oleifera exposed to water stress
err2018-08-18
err0
errOAAI
errCecilia Brunetti; Francesco Loreto; Francesco Ferrini; Antonella Gori; Lucia Guidi; Damiano Remorini; Mauro Centritto; Alessio Fini; Massimiliano Tattini
err分享
err收藏
Gregor J. Mendel - genetics founding father
err2014-06-30
err0
errOAAI
errErik SCHWARZBACH; Petr SMÝKAL; Ondřej DOSTÁL; Michaela JARKOVSKÁ; Simona VALOVÁ
err分享
err收藏
学者 查看更多内容