arrow
Return

A survey on multi-objective hyperparameter optimization algorithms for machine learning

delete2022-12-24
delete44
delete
OA
AI
M
Morales-Hernandez, Alejandro *
I
Inneke Van Nieuwenhuyse
G
Gonzalez, Sebastian Rojas
DOI:10.1007/s10462-022-10359-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO; most of these are focused on optimizing one performance measure (usually an error-based measure), and the literature on such single-objective HPO problems is vast. Recently, though, algorithms have appeared that focus on optimizing multiple conflicting objectives simultaneously. This article presents a systematic survey of the literature published between 2014 and 2020 on multi-objective HPO algorithms, distinguishing between metaheuristic-based algorithms, metamodel-based algorithms and approaches using a mixture of both. We also discuss the quality metrics used to compare multi-objective HPO procedures and present future research directions.
Keywords:
Hyperparameter optimization
Multi-objective optimization
Metamodel
Meta-heuristic
Machine learning

Journal

Artificial Intelligence Review cover
Artificial Intelligence Review
IF:
13.9
Papers:
6.1K
Citations:
1.9W

Organization

H
Hasselt University
Scholars:
6.4K
Papers: 5.3K
Citations: 7.6K
Cited Papers

Cited Papers

err2000-11-01
err0
PREAI
errWim G. J. Hol
errShare
errSave
The role of interleukin‐1 and tumour necrosis factor‐α in human multiple myeloma
err2008-03-12
err0
PREAI
errAnna Carter; Shoshana Merchav; Ilana Silvian‐Draxler; Ilana Tatarsky
errShare
errSave
Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints
err2019-10-01
err35
errOAAI
errGarrido-Merchan, Eduardo C.; Hernandez-Lobato, Daniel
errShare
errSave
Disrupted Dopamine Transmission and the Emergence of Exaggerated Beta Oscillations in Subthalamic Nucleus and Cerebral Cortex
err2008-04-30
err0
errOAAI
errNicolas Mallet; Alek Pogosyan; Andrew Sharott; Jozsef Csicsvari; J. Paul Bolam; Peter Brown; Peter J. Magill
errShare
errSave
NETs and CF Lung Disease: Current Status and Future Prospects
err2015-01-15
err0
errOAAI
errRobert Gray; Brian McCullagh; Paul McCray
errShare
errSave
Factors promoting microbial diversity in the McMurdo Dry Valleys, Antarctica
err2010-04-29
err0
PREAI
errCristina Takacs-Vesbach; Lydia Zeglin; J.E. Barrett; Michael N. Gooseff; John C. Priscu
errShare
errSave
researcher View more