arrow
Return

Automated machine learning: past, present and future

delete2024-04-18
delete8
delete
OA
AI
B
Baratchi, Mitra *
W
Wang, Can
L
Limmer, Steffen
V
van Rijn, Jan N.
H
Hoos, Holger
B
Back, Thomas
O
Olhofer, Markus
DOI:10.1007/s10462-024-10726-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Automated machine learning (AutoML) is a young research area aiming at making high-performance machine learning techniques accessible to a broad set of users. This is achieved by identifying all design choices in creating a machine-learning model and addressing them automatically to generate performance-optimised models. In this article, we provide an extensive overview of the past and present, as well as future perspectives of AutoML. First, we introduce the concept of AutoML, formally define the problems it aims to solve and describe the three components underlying AutoML approaches: the search space, search strategy and performance evaluation. Next, we discuss hyperparameter optimisation (HPO) techniques commonly used in AutoML systems design, followed by providing an overview of the neural architecture search, a particular case of AutoML for automatically generating deep learning models. We further review and compare available AutoML systems. Finally, we provide a list of open challenges and future research directions. Overall, we offer a comprehensive overview for researchers and practitioners in the area of machine learning and provide a basis for further developments in AutoML.
Keywords:
Automated machine learning
Neural architecture search
Hyperparameter optimisation
Search space
Search strategy

Journal

Artificial Intelligence Review cover
Artificial Intelligence Review
IF:
13.9
Papers:
6.1K
Citations:
1.9W

Organization

L
leiden university - excl lumc
Scholars:
3.5W
Papers: 2.9W
Citations: 46
L
Leiden University
Scholars:
4.0W
Papers: 3.3W
Citations: 3.8W