arrow
返回

A survey on multi-objective hyperparameter optimization algorithms for machine learning

delete2022-12-24
delete44
delete
OA
AI
M
Morales-Hernandez, Alejandro *
I
Inneke Van Nieuwenhuyse
G
Gonzalez, Sebastian Rojas
DOI:10.1007/s10462-022-10359-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO; most of these are focused on optimizing one performance measure (usually an error-based measure), and the literature on such single-objective HPO problems is vast. Recently, though, algorithms have appeared that focus on optimizing multiple conflicting objectives simultaneously. This article presents a systematic survey of the literature published between 2014 and 2020 on multi-objective HPO algorithms, distinguishing between metaheuristic-based algorithms, metamodel-based algorithms and approaches using a mixture of both. We also discuss the quality metrics used to compare multi-objective HPO procedures and present future research directions.
Keyword:
Hyperparameter optimization
Multi-objective optimization
Metamodel
Meta-heuristic
Machine learning

期刊

Artificial Intelligence Review 封面图
Artificial Intelligence Review
IF:
13.9
论文数:
6.1K
被引数:
1.9W

机构

H
Hasselt University
学者数:
6.4K
论文数: 5.3K
被引数: 7.6K
引用论文

引用论文

err2000-11-01
err0
PREAI
errWim G. J. Hol
err分享
err收藏
The role of interleukin‐1 and tumour necrosis factor‐α in human multiple myeloma
err2008-03-12
err0
PREAI
errAnna Carter; Shoshana Merchav; Ilana Silvian‐Draxler; Ilana Tatarsky
err分享
err收藏
Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints
err2019-10-01
err35
errOAAI
errGarrido-Merchan, Eduardo C.; Hernandez-Lobato, Daniel
err分享
err收藏
Disrupted Dopamine Transmission and the Emergence of Exaggerated Beta Oscillations in Subthalamic Nucleus and Cerebral Cortex
err2008-04-30
err0
errOAAI
errNicolas Mallet; Alek Pogosyan; Andrew Sharott; Jozsef Csicsvari; J. Paul Bolam; Peter Brown; Peter J. Magill
err分享
err收藏
NETs and CF Lung Disease: Current Status and Future Prospects
err2015-01-15
err0
errOAAI
errRobert Gray; Brian McCullagh; Paul McCray
err分享
err收藏
Factors promoting microbial diversity in the McMurdo Dry Valleys, Antarctica
err2010-04-29
err0
PREAI
errCristina Takacs-Vesbach; Lydia Zeglin; J.E. Barrett; Michael N. Gooseff; John C. Priscu
err分享
err收藏
学者 查看更多内容