arrow
返回

Surrogate-assisted multi-objective model selection for support vector machines

delete2015-02-01
delete29
PRE
AI
A
Alejandro Rosales-Pérez *
J
Jesús A. González
C
Carlos A. Coello Coello
H
Hugo Jair Escalante
C
Carlos A. Reyes-García
DOI:10.1016/j.neucom.2014.08.075delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Classification is one of the most well-known tasks in supervised learning. A vast number of algorithms for pattern classification have been proposed so far. Among these, support vector machines (SVMs) are one of the most popular approaches, due to the high performance reached by these methods in a wide number of pattern recognition applications. Nevertheless, the effectiveness of SVMs highly depends on their hyper-parameters. Besides the fine-tuning of their hyper-parameters, the way in which the features are scaled as well as the presence of non-relevant features could affect their generalization performance. This paper introduces an approach for addressing model selection for support vector machines used in classification tasks. In our formulation, a model can be composed of feature selection and pre-processing methods besides the SVM classifier. We formulate the model selection problem as a multi-objective one, aiming to minimize simultaneously two components that are closely related to the error of a model: bias and variance components, which are estimated in an experimental fashion. A surrogate-assisted evolutionary multi-objective optimization approach is adopted to explore the hyper-parameters space. We adopted this approach due to the fact that estimating the bias and variance could be computationally expensive. Therefore, by using surrogate-assisted optimization, we expect to reduce the number of solutions evaluated by the fitness functions so that the computational cost would also be reduced. Experimental results conducted on benchmark datasets widely used in the literature, indicate that highly competitive models with a fewer number of fitness function evaluations are obtained by our proposal when it is compared to state of the art model selection methods. (C) 2014 Elsevier B.V. All rights reserved.
Keyword:
Model selection
Multi-objective optimization
Support vector machines
Surrogate-assisted optimization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

I
instituto politecnico nacional - mexico
学者数:
1.6W
论文数: 1.0W
被引数: 3
I
instituto nacional de astrofisica, optica y electronica
学者数:
1.7K
论文数: 1.5K
被引数: 1
引用论文

引用论文

err分享
err收藏
Interleukin-18 secretion and Th1-like cytokine responses in human peripheral blood mononuclear cells under the influence of the toll-like receptor-5 ligand flagellin
err2006-02-01
err0
errOAAI
errMalte Bachmann; Katharina Horn; Marco A. Poleganov; Jens Paulukat; Marcel Nold; Josef Pfeilschifter; Heiko Muhl
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Effects of Long-Term Administration of Freeze-Dried Chokeberry Juice to Rats
err2014-05-05
err0
errOAAI
errTeresa Adamska; Małgorzata Ewertowska; Ewa Ignatowicz; Małgorzata Kujawska; Marcin Kidoń; Arleta Matuszewska; Jan Oszmiański; Hanna Szaefer; Jadwiga Jodynis-Liebert
err分享
err收藏
Choosing multiple parameters for support vector machines
err2002-01-01
err2.0K
errOAAI
errChapelle, O; Vapnik, V; Bousquet, O; Mukherjee, S
err分享
err收藏
学者 查看更多内容