.png){kind=icon}
Return
Hyper-Parameter Optimization Using MARS Surrogate for Machine-Learning Algorithms
.png){kind=icon}
PRE
AI
DOI：10.1109/TETCI.2019.2918509.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Automatically searching for optimal hyper parameters is of crucial importance for applying machine learning algorithms in practice. However, there are concerns regarding the tradeoff between efficiency and effectiveness of current approaches when faced with the expensive function evaluations. In this paper, a novel efficient hyper-parameter optimization algorithm is proposed (called MARSAOP), in which multivariate spline functions are used as surrogate and dynamic coordinate search approach is employed to generate the candidate points. Empirical studies on benchmark problems and machine-learning models (e.g.,SVM, RE, and NN) demonstrate that the proposed algorithm is able to find relatively high-quality solutions for benchmark problems and excellent hyper-parameter configurations for machine-learning models using a limited computational budget (few function evaluations).
Keywords:
Hyper-parameter optimization
MARS
dynamic coordinate search
machine learning
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
I
IF:
6.5
Papers:
1.4K
Citations:
4.5K
Organization
Cited Papers
.png){kind=icon}
ShareSaveShareSaveShareSaveShareSave
View more