Hyper-parameter optimization in classification: To-do or not-to-do

Ngoc Tran

doi:10.1016/j.patcog.2020.107245

Return

Hyper-parameter optimization in classification: To-do or not-to-do

2020-07-01

PRE

DOI：10.1016/j.patcog.2020.107245

Original

Original request for help

Save

Abstract

En 中文

Hyper-parameter optimization is a process to find suitable hyper-parameters for predictive models. It typically incurs highly demanding computational costs due to the need of the time-consuming model training process to determine the effectiveness of each set of candidate hyper-parameter values. A priori, there is no guarantee that hyper-parameter optimization leads to improved performance. In this work, we propose a framework to address the problem of whether one should apply hyper-parameter optimization or use the default hyper-parameter settings for traditional classification algorithms. We implemented a prototype of the framework, which we use a basis for a three-fold evaluation with 486 datasets and 4 algorithms. The results indicate that our framework is effective at supporting modeling tasks in avoiding adverse effects of using ineffective optimizations. The results also demonstrate that incrementally adding training datasets improves the predictive performance of framework instantiations and hence enables life-long learning. (C) 2020 Elsevier Ltd. All rights reserved.

Keywords:

Hyper-parameter optimization

Framework

Bayesian optimization

Machine learning

Incremental learning

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.