arrow
返回

Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

delete2023-01-16
delete243
delete
OA
AI
B
Bernd Bischl *
M
Martin Binder
M
Michel Lang
T
Tobias Pielok
J
Jakob Richter
S
Stefan Coors
J
Janek Thomas
T
Theresa Ullmann
M
Marc Becker
A
Anne‐Laure Boulesteix
D
Difan Deng
M
Marius Lindauer
DOI:10.1002/widm.1484delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Most machine learning algorithms are configured by a set of hyperparameters whose values must be carefully chosen and which often considerably impact performance. To avoid a time-consuming and irreproducible manual process of trial-and-error to find well-performing hyperparameter configurations, various automatic hyperparameter optimization (HPO) methods-for example, based on resampling error estimation for supervised machine learning-can be employed. After introducing HPO from a general perspective, this paper reviews important HPO methods, from simple techniques such as grid or random search to more advanced methods like evolution strategies, Bayesian optimization, Hyperband, and racing. This work gives practical recommendations regarding important choices to be made when conducting HPO, including the HPO algorithms themselves, performance evaluation, how to combine HPO with machine learning pipelines, runtime improvements, and parallelization.This article is categorized under:Algorithmic Development > StatisticsTechnologies > Machine LearningTechnologies > Prediction
Keyword:
automl
hyperparameter optimization
machine learning
model selection
tuning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery 封面图
Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery
IF:
11.7
论文数:
548
被引数:
5.3K

机构

D
dortmund university of technology
学者数:
9.4K
论文数: 9.1K
被引数: 15
U
University of Munich
学者数:
5.7W
论文数: 4.2W
被引数: 68
引用论文

引用论文

err分享
err收藏
Detecting Genes with Ligases
err1996-02-01
err0
PREAI
errUlf Landegren; Martina Samiotaki; Mats Nilsson; Helena Malmgren; Marek Kwiatkowski
err分享
err收藏
Herbicide-resistant crops as weeds in North America.
err2007-09-05
err0
PREAI
errH. J. Beckie; M. D. K. Owen
err分享
err收藏
学者 查看更多内容