返回
Concurrent surrogate model selection (COSMOS): optimizing model type, kernel function, and hyper-parameters
DOI:10.1007/s00158-017-1797-y.png)
摘要
En 中文
This paper presents an automated surrogate model selection framework called the Concurrent Surrogate Model Selection or COSMOS. Unlike most existing techniques, COSMOS coherently operates at three levels, namely: 1) selecting the model type (e.g., RBF or Kriging), 2) selecting the kernel function type (e.g., cubic or multiquadric kernel in RBF), and 3) determining the optimal values of the typically user-prescribed hyper-parameters (e.g., shape parameter in RBF). The quality of the models is determined and compared using measures of median and maximum error, given by the Predictive Estimation of Model Fidelity (PEMF) method. PEMF is a robust implementation of sequential k-fold cross-validation. The selection process undertakes either a cascaded approach over the three levels or a more computationally-efficient one-step approach that solves a mixed-integer nonlinear programming problem. Genetic algorithms are used to perform the optimal selection. Application of COSMOS to benchmark test functions resulted in optimal model choices that agree well with those given by analyzing the model errors on a large set of additional test points. For the four analytical benchmark problems and three practical engineering applications - airfoil design, window heat transfer modeling, and building energy modeling - diverse forms of models/kernels are observed to be selected as optimal choices. These observations further establish the need for automated multi-level model selection that is also guided by dependable measures of model fidelity.
Keyword:
Automated surrogate model selection
Hyper-parameter optimization
Kriging
Mixed-integer non-linear programming (MINLP)
Predictive estimation of model fidelity (PEMF)
Radial basis functions (RBF)
Support vector regression (SVR)
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4
论文数:
4.9K
被引数:
1.9W
机构
引用论文
A meta-learning method to select the kernel width in Support Vector Regression支持向量回归中核宽度选择的元学习方法
MACHINE LEARNING
IF2.9

