arrow
Return

Practitioner Motives to Use Different Hyperparameter Optimization Methods

delete2025-12-01
delete1
PRE
AI
N
Niclas Kannengießer *
N
Niklas Hasebrook
F
Felix Morsbach
M
Marc-André Zöller
J
Jörg K. H. Franke
M
Marius Lindauer
F
Frank Hutter
A
Ali Sunyaev
DOI:10.1145/3745771delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Programmatic hyperparameter optimization (HPO) methods, such as Bayesian optimization and evolutionary algorithms, are known for their sample efficiency in identifying optimal configurations for machine learning (ML) models. However, practitioners often use less efficient methods, such as grid search, potentially resulting in under-optimized models. This discrepancy suggests that HPO method selection may be influenced by practitioner-specific motives, which remain insufficiently understood hindering user-centered advancement of HPO tools. To uncover these motives, we conducted 20 semi-structured interviews and an online survey with 49 ML practitioners. We revealed six primary goals (e.g., increasing ML model understanding) and 14 contextual factors (e.g., available computational resources) that influence practitioners' choices of HPO methods. This study provides a conceptual foundation for understanding real-world HPO practices and informs the development of more user-centered and context-adaptive HPO tools in automated ML (AutoML).
Keywords:
Artificial Intelligence (AI)
Automated Machine Learning (AutoML)
Human-AI Collaboration
Hyperparameter Optimization (HPO)
User-centered HPO

Journal

ACM Transactions on Computer-Human Interaction cover
ACM Transactions on Computer-Human Interaction
IF:
6.6
Papers:
73
Citations:
3.9K

Organization

H
helmholtz association
Scholars:
6.3K
Papers: 2.3K
Citations: 6
L
Leibniz University Hannover
Scholars:
1.1W
Papers: 8.5K
Citations: 1.1W
K
karlsruhe institute of technology
Scholars:
2.0W
Papers: 1.5W
Citations: 23
U
university of stuttgart
Scholars:
1.6K
Papers: 714
Citations: 0
U
university of freiburg
Scholars:
3.7K
Papers: 1.3K
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

ClaVis
err2020-10-02
err0
PREAI
errFrank Heyen; Tanja Munz; Michael Neumann; Daniel Ortega; Ngoc Thang Vu; Daniel Weiskopf; Michael Sedlmair
errShare
errSave
How Many Interviews Are Enough?
err2006-02-01
err0
PREAI
errGreg Guest; Arwen Bunce; Laura Johnson
errShare
errSave
Bounded Rationality
err
IF0
err2002-01-01
err0
PREAI
err
errShare
errSave
Multi-Objective Hyperparameter Optimization in Machine Learning—An Overview
err2023-12-12
err0
errOAAI
errFlorian Karl; Tobias Pielok; Julia Moosbauer; Florian Pfisterer; Stefan Coors; Martin Binder; Lennart Schneider; Janek Thomas; Jakob Richter; Michel Lang; Eduardo C. Garrido-Merchán; Juergen Branke; Bernd Bischl
errShare
errSave
A Metric Learning Reality Check
err2020-11-20
err0
PREAI
errKevin Musgrave; Serge Belongie; Ser-Nam Lim
errShare
errSave
Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
err2023-01-16
err243
errOAAI
errBischl, Bernd; Binder, Martin; Lang, Michel; Pielok, Tobias; Richter, Jakob; Coors, Stefan; Thomas, Janek; Ullmann, Theresa; Becker, Marc; Boulesteix, Anne-Laure; Deng, Difan; Lindauer, Marius
errShare
errSave
researcher View more