arrow
Return

Multi-objective adaptive differential evolution for SVM/SVR hyperparameters selection

delete2021-02-01
delete71
PRE
AI
C
Carlos Eduardo da Silva Santos
R
Renato Coral Sampaio
L
Leandro dos Santos Coelho
G
Guillermo Alvarez Bestard
C
Carlos H. Llanos *
DOI:10.1016/j.patcog.2020.107649delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Parameters Selection Problem (PSP) is a relevant and complex optimization issue in Support Vector Machine (SVM) and Support Vector Regression (SVR), looking for obtaining an optimal set of hyperparameters. In our case, the optimization problem is addressed to obtain models that minimize the number of support vectors and maximize generalization capacity. However, to obtain accurate and low complexity solutions, defining an adequate kernel function and the SVM/SVR's hyperparameters are necessary, which currently represents a relevant research topic. To tackle this problem, this work proposes a multiobjective metaheuristic named Adaptive Parameter control with Mutant Tournament Multi-Objective Differential Evolution (APMT-MODE). Its performance is first tested in a series of benchmarks for classification and regression problems using simple kernels such as Gaussian and polynomial kernels. In both cases, the APMT-MODE is able to yield more precise and more straightforward solutions using simple kernels. Then, the approach is used on a real case study to create a welding bead depth and width SVR models for a Gas Metal Arc Welding (GMAW) process. Additionally, a study on kernel functions was developed in terms of computational effort, aiming to assess its performance for embedded systems applications. (c) 2020 Published by Elsevier Ltd.
Keywords:
Support vector machines
Parameters selection problem
Multi-objective optimization
Differential evolution
Adaptive parameters strategy

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.4W
Citations:
4.5W

Organization

P
pontificia universidade catolica do parana
Scholars:
3.0K
Papers: 1.9K
Citations: 1
U
universidade de brasilia
Scholars:
1.1W
Papers: 7.3K
Citations: 5
Cited Papers

Cited Papers

A Three-Year Follow-Up Study of Infection with Trypanosoma Cruzi and Electrocardiographic Abnormalities in a Rural Community in Northeast Brazil
err1982-01-01
err0
PREAI
errJames H. Maguire; Kenneth E. Mott; Rodney Hoff; Armenio Guimarães; José T. Franca; José Antonio Almeida de Souza; Nilson Borges Ramos; Italo A. Sherlock
errShare
errSave
SARCOPTIC MANGE FOUND IN WOLVES IN THE ROCKY MOUNTAINS IN WESTERN UNITED STATES
err2010-10-01
err0
PREAI
errMichael D. Jimenez; Edward E. Bangs; Carolyn Sime; Valpa J. Asher
errShare
errSave
errShare
errSave
Bio-inspired computation: Where we stand and what's next
err2019-08-01
err438
errOAAI
errDel Ser, Javier; Osaba, Eneko; Molina, Daniel; Yang, Xin-She; Salcedo-Sanz, Sancho; Camacho, David; Das, Swagatam; Suganthan, Ponnuthurai N.; Coello Coello, Carlos A.; Herrera, Francisco
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Stereotyped: Investigating Gender in Introductory Science Courses
err2013-03-01
err0
errOAAI
errShanda Lauer; Jennifer Momsen; Erika Offerdahl; Mila Kryjevskaia; Warren Christensen; Lisa Montplaisir
errShare
errSave
researcher View more