返回
Multi-objective model type selection
DOI:10.1016/j.neucom.2014.05.077.png)
摘要
En 中文
Classification is a mainstream within the machine learning community. As a result, a large number of learning algorithms have been proposed. The performance of many of these could highly depend on the chosen values of their hyper-parameters. This paper introduces a novel method for addressing the model selection problem for a given classification task. In our model selection formulation, both the learning algorithm and its hyper-parameters are considered. In our proposed approach, model selection is tackled as a multi-objective optimization problem. The empirical error, or training error, and the model complexity are defined as the objectives. We adopt a multi-objective evolutionary algorithm as the search engine, due to its high performance and its advantages for solving multi-objective problems. The model complexity is estimated experimentally, in a general fashion, for any learning algorithm, through the VC dimension. Strategies for choosing a single model or for constructing an ensemble of models from the resulting non-dominated set are also proposed. Experimental results on benchmark data sets indicate the effectiveness of the proposed approach. Furthermore, a comparative study shows that the obtained models are highly competitive, in terms of generalization performance, with other methods in the state of the art that focus on a single-learning algorithm, or a single-objective approach. (C) 2014 Elsevier B.V. All rights reserved.
Keyword:
Model type selection
VC dimension
Multi-objective optimization
Ensemble methods
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Multiobjective evolutionary algorithms: A comparative case study and the Strength Pareto approach多目标进化算法: 比较案例研究和强度帕累托方法
A PSO and pattern search based memetic algorithm for SVMs parameters optimization
NEUROCOMPUTING
IF6.5
Particle swarm optimization for parameter determination and feature selection of support vector machines粒子群优化算法在支持向量机参数确定与特征选择中的应用
An Innate Host Defense Protein β2-Microglobulin Keeps a Check on α-Synuclein amyloid Assembly: Implications in Parkinson's Disease一种先天宿主防御蛋白β2-微球蛋白对α-突触核蛋白淀粉样纤维组装具有调控作用:对帕金森病的意义

