arrow
Return

Performance Metrics for Multiobjective Optimization Under Noise

delete2025-08-01
delete0
delete
OA
AI
J
Juergen Branke
DOI:10.1109/TEVC.2024.3438115delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article discusses the challenge when evaluating multiobjective optimization algorithms under noise. It argues that it is important to take into account possible selection errors by a decision maker, due to inaccurate estimates of a solution’s true objective values. It demonstrates that commonly used performance metrics do not properly account for such errors, and proposes two alternative performance metrics that do account for such errors by adapting the popular R2 and ${\mathrm { IGD}}^{+}$ metrics.
Keywords:
Benchmarking
multiobjective
noise
performance metric

Journal

IEEE Transactions on Evolutionary Computation cover
IEEE Transactions on Evolutionary Computation
IF:
12
Papers:
1.9K
Citations:
2.4W

Organization

U
University of Warwick
Scholars:
2.2W
Papers: 2.2W
Citations: 85
Cited Papers

Cited Papers

Multi-Objective Hyperparameter Optimization in Machine Learning—An Overview
err2023-12-12
err0
errOAAI
errFlorian Karl; Tobias Pielok; Julia Moosbauer; Florian Pfisterer; Stefan Coors; Martin Binder; Lennart Schneider; Janek Thomas; Jakob Richter; Michel Lang; Eduardo C. Garrido-Merchán; Juergen Branke; Bernd Bischl
errShare
errSave
Performance assessment of multiobjective optimizers: An analysis and review
err2003-04-01
err3.1K
errOAAI
errZitzler, E; Thiele, L; Laumanns, M; Fonseca, CM; da Fonseca, VG
errShare
errSave
A Toolkit for Generating Scalable Stochastic Multiobjective Test Problems
err2016-07-20
err0
PREAI
errSalomon,Shaul; Purshouse,Robin Charles; Giaghiozis,Ioannis; Fleming,Peter John
errShare
errSave
Performance indicators in multiobjective optimization
err2021-07-01
err238
errOAAI
errAudet, Charles; Bigeon, Jean; Cartier, Dominique; Le Digabel, Sebastien; Salomon, Ludovic
errShare
errSave
An Introduction to Multiobjective Simulation Optimization
err2019-01-24
err0
errOAAI
errSusan R. Hunter; Eric A. Applegate; Viplove Arora; Bryan Chong; Kyle Cooper; Oscar Rincón-Guevara; Carolina Vivas-Valencia
errShare
errSave
researcher View more