.png){kind=icon}
返回
Efficient hyperparameter optimization through model-based reinforcement learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2020.06.064.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Hyperparameter tuning is critical for the performance of machine learning algorithms. However, a noticeable limitation is the high computational cost of algorithm evaluation for complex models or for large datasets, which makes the tuning process highly inefficient. In this paper, we propose a novel model-based method for efficient hyperparameter optimization. Firstly, we frame this optimization process as a reinforcement learning problem and then employ an agent to tune hyperparameters sequentially. In addition, a model that learns how to evaluate an algorithm is used to speed up the training. However, model inaccuracy is further exacerbated by long-term use, resulting in collapse performance. We propose a novel method for controlling the model use by measuring the impact of the model on the policy and limiting it to a proper range. Thus, the horizon of the model use can be dynamically adjusted. We apply the proposed method to tune the hyperparameters of the extreme gradient boosting and convolutional neural networks on 101 tasks. The experimental results verify that the proposed method achieves the highest accuracy on 86.1% of the tasks, compared with other state-of-the-art methods and the average ranking of runtime is significant lower than all methods by using the predictive model. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Hyperparameter optimization
Machine learning
Reinforcement learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
7.1W
机构
暂无机构信息
引用论文
Coalition game for user association and bandwidth allocation in ultra-dense mmWave networks超密集毫米波网络中用户关联和带宽分配的联盟博弈
PREAI
分享收藏
Pre-training the deep generative models with adaptive hyperparameter optimization.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏A process dissociation framework: Separating automatic from intentional uses of memory过程分离框架: 将自动与有意使用的内存分开
PREAI
分享收藏Robot skill acquisition in assembly process using deep reinforcement learning基于深度强化学习的机器人装配技能获取NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏 没有更多内容
没有更多内容