arrow
Return

Hyper-parameter initialization of classification algorithms using dynamic time warping: A perspective on PCA meta-features

delete2023-02-01
delete3
PRE
AI
T
Tomáš Horváth *
R
Rafael Gomes Mantovani
A
André C. P. L. F. de Carvalho
DOI:10.1016/j.asoc.2022.109969delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Meta-learning, a concept from the area of automated machine learning, aims at providing decision support for data scientists by recommending a suitable setting (a machine learning algorithm or its hyper-parameters) to be used for a given dataset. Such a recommendation is based the assumption that an optimal setting for a certain dataset would also be suitable for other, similar datasets. Similarity of datasets is computed from their characteristics, named meta-features, several types of which have been developed thus far. This paper introduces a novel perspective on PCA meta-features which, despite their good descriptive characteristics and easy computation, are rarely used in meta-learning. A novel meta-learning approach utilizing DTW, a well-known similarity measure for time-series, is proposed for computing dataset similarities based on the series of cumulative variances explained by their respective principal components. The results from a large-scale experiment, comparing the proposed approach to multiple baselines on 50 real-world datasets, show the potential of combining PCA and DTW in meta-learning and encourage further investigation in this direction.
Keywords:
Meta-learning
Meta-features
Principal component analysis
Dynamic time warping
Hyper-parameter initialization

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

U
universidade tecnologica federal do parana
Scholars:
4.9K
Papers: 3.4K
Citations: 1
E
Eotvos Lorand University
Scholars:
7.5K
Papers: 6.3K
Citations: 84
U
universidade de sao paulo
Scholars:
10.5W
Papers: 6.7W
Citations: 93
researcher View more organizations