arrow
Return

Algorithm Recommendation and Performance Prediction Using Meta-Learning

delete2023-02-01
delete8
PRE
AI
G
Guilherme Palumbo
D
Davide Carneiro
M
Miguel Guimares
V
Victor Alves *
P
Paulo Nováis
DOI:10.1142/S0129065723500119delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the last years, the number of machine learning algorithms and their parameters has increased significantly. On the one hand, this increases the chances of finding better models. On the other hand, it increases the complexity of the task of training a model, as the search space expands significantly. As the size of datasets also grows, traditional approaches based on extensive search start to become prohibitively expensive in terms of computational resources and time, especially in data streaming scenarios. This paper describes an approach based on meta-learning that tackles two main challenges. The first is to predict key performance indicators of machine learning models. The second is to recommend the best algorithm/configuration for training a model for a given machine learning problem. When compared to a state-of-the-art method (AutoML), the proposed approach is up to 130x faster and only 4% worse in terms of average model quality. Hence, it is especially suited for scenarios in which models need to be updated regularly, such as in streaming scenarios with big data, in which some accuracy can be traded for a much shorter model training time.
Keywords:
Machine learning
meta-learning
streaming
active learning

Journal

International Journal of Neural Systems cover
International Journal of Neural Systems
IF:
6.4
Papers:
1.2K
Citations:
3.3K

Organization

I
instituto politecnico do porto
Scholars:
2.8K
Papers: 2.7K
Citations: 2
U
universidade do minho
Scholars:
1.1W
Papers: 1.1W
Citations: 10