返回
A survey on multi-objective hyperparameter optimization algorithms for machine learning
DOI:10.1007/s10462-022-10359-2.png)
摘要
En 中文
Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO; most of these are focused on optimizing one performance measure (usually an error-based measure), and the literature on such single-objective HPO problems is vast. Recently, though, algorithms have appeared that focus on optimizing multiple conflicting objectives simultaneously. This article presents a systematic survey of the literature published between 2014 and 2020 on multi-objective HPO algorithms, distinguishing between metaheuristic-based algorithms, metamodel-based algorithms and approaches using a mixture of both. We also discuss the quality metrics used to compare multi-objective HPO procedures and present future research directions.
Keyword:
Hyperparameter optimization
Multi-objective optimization
Metamodel
Meta-heuristic
Machine learning
期刊
IF:
13.9
论文数:
6.1K
被引数:
1.9W
机构
引用论文
Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints
NEUROCOMPUTING
IF6.5
Automatically Design Convolutional Neural Networks by Optimization With Submodularity and Supermodularity通过亚模块化和超模块化优化自动设计卷积神经网络
Multiobjective evolutionary algorithms: A comparative case study and the Strength Pareto approach多目标进化算法: 比较案例研究和强度帕累托方法
Coalition game for user association and bandwidth allocation in ultra-dense mmWave networks超密集毫米波网络中用户关联和带宽分配的联盟博弈

