arrow
返回

Improving classification performance of Support Vector Machine by genetically optimising kernel shape and hyper-parameters

delete2010-10-27
delete77
PRE
AI
L
Laura Dioşan *
A
Alexandrina Rogozan
J
Jean-Pierre Pécuchet
DOI:10.1007/s10489-010-0260-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Support Vector Machines (SVMs) deliver state-of-the-art performance in real-world applications and are now established as one of the standard tools for machine learning and data mining. A key problem of these methods is how to choose an optimal kernel and how to optimise its parameters. The real-world applications have also emphasised the need to consider a combination of kernels-a multiple kernel-in order to boost the classification accuracy by adapting the kernel to the characteristics of heterogeneous data. This combination could be linear or non-linear, weighted or un-weighted. Several approaches have been already proposed to find a linear weighted kernel combination and to optimise its parameters together with the SVM parameters, but no approach has tried to optimise a non-linear weighted combination. Therefore, our goal is to automatically generate and adapt a kernel combination (linear or non-linear, weighted or un-weighted, according to the data) and to optimise both the kernel parameters and SVM parameters by evolutionary means in a unified framework. We will denote our combination as a kernel of kernels (KoK). Numerical experiments show that the SVM algorithm, involving the evolutionary kernel of kernels (eKoK) we propose, performs better than well-known classic kernels whose parameters were optimised and a state of the art convex linear and an evolutionary linear, respectively, kernel combinations. These results emphasise the fact that the SVM algorithm could require a non-linear weighted combination of kernels.
Keyword:
Classification problems
Kernel of kernels
Multiple kernel
SVM
Hyper-parameters optimisation
Hybrid model
Genetic programming

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

U
universite de rouen normandie
学者数:
9.8K
论文数: 6.5K
被引数: 6
B
babes bolyai university from cluj
学者数:
5.4K
论文数: 4.3K
被引数: 0
引用论文

引用论文

Diseases and Molecular Diagnostics: A Step Closer to Precision Medicine
err2017-08-22
err0
errOAAI
errShailendra Dwivedi; Purvi Purohit; Radhieka Misra; Puneet Pareek; Apul Goel; Sanjay Khattri; Kamlesh Kumar Pant; Sanjeev Misra; Praveen Sharma
err分享
err收藏
err分享
err收藏
Choosing multiple parameters for support vector machines
err2002-01-01
err2.0K
errOAAI
errChapelle, O; Vapnik, V; Bousquet, O; Mukherjee, S
err分享
err收藏
Total red blood cell concentrations of ω-3 fatty acids are associated with emotion-elicited neural activity in adolescent boys with attention-deficit hyperactivity disorder
err2009-02-01
err0
PREAI
errRachel V. Gow; Toshiko Matsudaira; Eric Taylor; Katya Rubia; Michael Crawford; Kebreab Ghebremeskel; Almira Ibrahimovic; Frédéric Vallée-Tourangeau; Leanne M. Williams; Alexander Sumich
err分享
err收藏
OPTIMIZATION BY SIMULATED ANNEALING模拟退火优化
errSCIENCE
IF45.8
err1983-05-13
err3.2W
PREAI
errKIRKPATRICK, S; GELATT, CD; VECCHI, MP
err分享
err收藏
学者 查看更多内容