arrow
Return

Evolving data-adaptive support vector machines for binary classification

delete2021-09-01
delete28
PRE
AI
W
Wojciech Dudzik
J
Jakub Nalepa
M
Michał Kawulok *
DOI:10.1016/j.knosys.2021.107221delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Support vector machines (SVMs) have been exploited in a plethora of real-life classification and regression tasks, and are one of the most researched supervised learners. However, their generalization abilities strongly depend on the pivotal hyperparameters of the classifier, alongside its training dataset. Also, the training process is computationally and memory expensive, hence learning multiple SVMs to grid-search the hyperparameter space is infeasible in practice. In this paper, we address the problem of optimizing SVMs for binary classification of difficult datasets, including very large and extremely imbalanced cases. We propose an evolutionary technique that simultaneously optimizes the critical SVM aspects, including the training sample, kernel functions, and features. Also, we introduce a co-evolutionary scheme that allows us to guide the search in a competitive way to the highest-quality solutions. Our extensive experimental study performed over more than 120 benchmarks showed that the proposed algorithm outperforms popular supervised learners, as well as other techniques for optimizing SVMs reported in the literature. (C) 2021 Elsevier B.V. All rights reserved.
Keywords:
Support vector machine
Evolutionary algorithm
Training set selection
Model optimization
Kernel function
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

S
Silesian University of Technology
Scholars:
6.2K
Papers: 6.2K
Citations: 5.9K
Cited Papers

Cited Papers

Evidence of temperature depression and hydrological variations in the eastern Sierra Nevada during the Younger Dryas Stade
err2017-01-20
err0
PREAI
errGlen M. MacDonald; Katrina A. Moser; Amy M. Bloom; David F. Porinchu; Aaron P. Potito; Brent B. Wolfe; Thomas W.D. Edwards; Amanda Petel; Antony R. Orme; Amalie Jo Orme
errShare
errSave
A Three-Year Follow-Up Study of Infection with Trypanosoma Cruzi and Electrocardiographic Abnormalities in a Rural Community in Northeast Brazil
err1982-01-01
err0
PREAI
errJames H. Maguire; Kenneth E. Mott; Rodney Hoff; Armenio Guimarães; José T. Franca; José Antonio Almeida de Souza; Nilson Borges Ramos; Italo A. Sherlock
errShare
errSave
Efficient benchmarking of algorithm configurators via model-based surrogates
err2017-12-22
err29
errOAAI
errEggensperger, Katharina; Lindauer, Marius; Hoos, Holger H.; Hutter, Frank; Leyton-Brown, Kevin
errShare
errSave
Wavelet twin support vector machines based on glowworm swarm optimization
err2017-02-01
err69
PREAI
errDing, Shifei; An, Yuexuan; Zhang, Xiekai; Wu, Fulin; Xue, Yu
errShare
errSave
An efficient intrusion detection system based on hypergraph - Genetic algorithm for parameter optimization and feature selection in support vector machine
err2017-10-01
err171
PREAI
errRaman, M. R. Gauthama; Somu, Nivethitha; Kirthivasan, Kannan; Liscano, Ramiro; Sriram, V. S. Shankar
errShare
errSave
Effects of azithromycin on tilapia (Oreochromis niloticus): health status evaluation using biochemical, physiological and morphological biomarkers
err2016-09-15
err0
errOAAI
errNatália Sayuri Shiogiri; Cynthia Venâncio Ikefuti; Silvia Patricia Carraschi; Claudinei da Cruz; Marisa Narciso Fernandes
errShare
errSave
researcher View more