.png){kind=icon}
返回
ExperienceThinking: Constrained hyperparameter optimization based on knowledge and pruning
.png){kind=icon}
OA
AI
DOI：10.1016/j.knosys.2020.106602.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Machine learning models are very sensitive to the hyperparameters, and their evaluations are generally expensive. Users desperately need intelligent methods to quickly optimize hyperparameter settings according to known evaluation information, so as to effectively promote the performance of the machine learning models within the limited and small budget. Motivated by this, in this paper, we propose ExperienceThinking algorithm to quickly find the best possible hyperparameter configuration of machine learning algorithms within a few configuration evaluations. ExperienceThinking designs two novel approaches, which make full use of the known evaluation information to intelligently infer optimal configurations from two aspects: search space pruning and knowledge utilization respectively. Two approaches suit for two different kinds of constrained hyperparameter optimization problems, they complement with each other and their combination increases the generality and effectiveness of the ExperienceThinking. To demonstrate the benefit of ExperienceThinking, we conduct extensive experiments using various constrained hyperparameter optimization problems, and compare it with classic hyperparameter optimization algorithms. The experimental results present that our proposed algorithm provides superior results and the design of our proposed algorithm is reasonable. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Automated machine learning
Constrained hyperparameter optimization
Machine learning algorithms
Hyperparameter optimization
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
K
IF:
7.6
论文数:
1.2W
被引数:
4.5W
机构
引用论文
.png){kind=icon}
分享收藏Global and Local Surrogate-Assisted Differential Evolution for Expensive Constrained Optimization Problems With Inequality Constraints具有不等式约束的昂贵约束优化问题的全局和局部代理辅助差分进化OAAI
OAAI分享收藏The power of obfuscation techniques in malicious JavaScript code: A measurement study恶意JavaScript代码中混淆技术的功能: 一项测量研究OAAI
OAAI分享收藏分享收藏
分享收藏Hyperparameter optimization of deep neural network using univariate dynamic encoding algorithm for searches基于单变量动态编码搜索算法的深度神经网络超参数优化
PREAI
分享收藏
查看更多内容