arrow
Return

Two Novel Instance Selection Methods Combining Algorithm Performance and Landscape Analysis: A Comparative Study in Continuous Optimization

delete2025-11-03
delete0
PRE
AI
L
Linas Stripinis
J
Jakub Kůdela
R
Remigijus Paulavičius
DOI:10.1109/TCYB.2025.3625095delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A reliable benchmark library is essential for advancing research in global optimization by enabling fair comparisons and rigorous testing of optimization algorithms across diverse problem landscapes. In this article, we focus on instance selection methods, which aim to choose representative problems for evaluating algorithm performance. We present a comprehensive review of existing instance selection methods, highlighting their strengths and limitations, particularly in balancing the consideration of algorithm performance and the analysis of problem characteristics using exploratory landscape analysis. Building on these insights, we introduce two novel instance selection methods that leverage both algorithm performance data and landscape analysis information to construct diverse and informative benchmark sets. For evaluation, we benchmark our approaches against four existing instance selection methods on the recently expanded DIRECTGOLib v2.0 library. Our results demonstrate that the proposed methods effectively identify representative instances that capture a wide range of problem characteristics, enabling a more comprehensive evaluation of algorithm performance. These findings have significant implications for the development and assessment of new optimization algorithms, ultimately contributing to more reliable and robust solutions for real-world optimization problems.
Keywords:
Algorithm performance
black-box global optimization
exploratory landscape analysis
instance selection methods
numerical benchmarking

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

B
brno university of technology
Scholars:
949
Papers: 373
Citations: 0
V
vilnius university
Scholars:
1.5K
Papers: 622
Citations: 0
Cited Papers

Cited Papers

errShare
errSave
Guidelines for reporting results of computational experiments. Report of the ad hoc committee
err1990-11-01
err0
PREAI
errRichard H. F. Jackson; Paul T. Boggs; Stephen G. Nash; Susan Powell
errShare
errSave
MIPLIB 2017: data-driven compilation of the 6th mixed-integer programming library
err2021-01-07
err111
errOAAI
errGleixner, Ambros; Hendel, Gregor; Gamrath, Gerald; Achterberg, Tobias; Bastubbe, Michael; Berthold, Timo; Christophel, Philipp; Jarck, Kati; Koch, Thorsten; Linderoth, Jeff; Lubbecke, Marco; Mittelmann, Hans D.; Ozyurt, Derya; Ralphs, Ted K.; Salvagnin, Domenico; Shinano, Yuji
errShare
errSave
Exploratory Landscape Analysis is Strongly Sensitive to the Sampling Strategy
err2020-09-02
err0
errOAAI
errQuentin Renau; Carola Doerr; Johann Dreo; Benjamin Doerr
errShare
errSave
researcher View more