arrow
返回

An Efficient Contesting Procedure for AutoML Optimization

delete2022-01-01
delete4
delete
OA
AI
D
Duc Anh Nguyen *
A
Anna V. Kononova
S
Stefan Menzel
B
Bernhard Sendhoff
T
Thomas Bäck
DOI:10.1109/ACCESS.2022.3192036delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Automated Machine Learning (AutoML) frameworks are designed to select the optimal combination of operators and hyperparameters. Classical AutoML-based Bayesian Optimization approaches often integrate all operator search spaces into a single search space. However, a disadvantage of this history-based strategy is that it can be less robust when initialized randomly than optimizing each operator algorithm combination independently. To overcome this issue, a novel contesting procedure algorithm, Divide And Conquer Optimization (DACOpt), is proposed to make AutoML more robust. DACOpt partitions the AutoML search space into a reasonable number of sub-spaces based on algorithm similarity and budget constraints. Furthermore, throughout the optimization process, DACOpt allocates resources to each sub-space to ensure that (1) all areas of the search space are covered and (2) more resources are assigned to the most promising sub-space. Two extensive sets of experiments on 117 benchmark datasets demonstrate that DACOpt achieves significantly better results in 36% of AutoML benchmark datasets: 5% when to compared to TPOT, 8% - to AutoSklearn, 15% - to H20 and 18% - to ATM.
Keyword:
Optimization
Pipelines
Machine learning
Bayes methods
Classification algorithms
Search problems
Mathematical models
Automated machine learning (AutoML) optimization
machine learning
divide and conquer
Bayesian optimization
hyperparameter optimization
classification

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

L
leiden university - excl lumc
学者数:
3.5W
论文数: 2.9W
被引数: 46
L
Leiden University
学者数:
4.0W
论文数: 3.3W
被引数: 3.8W
引用论文

引用论文

Detecting Genes with Ligases
err1996-02-01
err0
PREAI
errUlf Landegren; Martina Samiotaki; Mats Nilsson; Helena Malmgren; Marek Kwiatkowski
err分享
err收藏
In Vitro Nematocidal Effect and Anthelmintic Activity of Artemisia cina Against Haemonchus contortus in Gerbils and Relative Expression of Hc29 Gene in Transitional Larvae (L3–L4)
err2021-03-15
err0
PREAI
errRosa Isabel Higuera-Piedrahita; Mariana Dolores-Hernández; Luis Gerardo Jiménez-Pérez; Brígida C. Camacho-Enríquez; Alejandro Zamilpa; Raquel López-Arellano; Pedro Mendoza-de-Gives; Jorge A. Cuéllar-Ordaz; Ma. Eugenia López-Arellano
err分享
err收藏
Lead-free KNN-based thin films obtained by pulsed laser deposition通过脉冲激光沉积获得的无铅KNN基薄膜
err2022-06-27
err0
errOAAI
errBrenda Carreno-Jimenez; Jose Luis Benitez-Benitez; Rosalba Castaneda-Guzman; M. Acuautla; Rigoberto Lopez-Juarez
err分享
err收藏
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
学者 查看更多内容