arrow
返回

Hyper-Parameter Optimization of Kernel Functions on Multi-Class Text Categorization: A Comparative Evaluation

delete2024-11-27
delete0
PRE
AI
M
Michael Loki *
A
Agnes Mindila
DOI:10.1002/widm.1572delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, machine learning (ML) has witnessed a paradigm shift in kernel function selection, which is pivotal in optimizing various ML models. Despite multiple studies about its significance, a comprehensive understanding of kernel function selection, particularly about model performance, still needs to be explored. Challenges remain in selecting and optimizing kernel functions to improve model performance and efficiency. The study investigates how gamma parameter and cost parameter influence performance metrics in multi-class classification tasks using various kernel-based algorithms. Through sensitivity analysis, the impact of these parameters on classification performance and computational efficiency is assessed. The experimental setup involves deploying ML models using four kernel-based algorithms: Support Vector Machine, Radial Basis Function, Polynomial Kernel, and Sigmoid Kernel. Data preparation includes text processing, categorization, and feature extraction using TfidfVectorizer, followed by model training and validation. Results indicate that Support Vector Machine with default settings and Radial Basis Function kernel consistently outperforms polynomial and sigmoid kernels. Adjusting gamma improves model accuracy and precision, highlighting its role in capturing complex relationships. Regularization cost parameters, however, show minimal impact on performance. The study also reveals that configurations with moderate gamma values achieve better balance between performance and computational time compared to higher gamma values or no gamma adjustment. The findings underscore the delicate balance between model performance and computational efficiency by highlighting the trade-offs between model complexity and efficiency.
Keyword:
hyper-parameter
kernel based algorithms
multi-class
optimization

期刊

Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery 封面图
Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery
IF:
11.7
论文数:
548
被引数:
5.3K

机构

J
jomo kenyatta university of agriculture & technology
学者数:
1.2K
论文数: 796
被引数: 0
引用论文

引用论文

Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges超参数优化: 基础、算法、最佳实践和开放挑战
err2023-01-16
err243
errOAAI
errBischl, Bernd; Binder, Martin; Lang, Michel; Pielok, Tobias; Richter, Jakob; Coors, Stefan; Thomas, Janek; Ullmann, Theresa; Becker, Marc; Boulesteix, Anne-Laure; Deng, Difan; Lindauer, Marius
err分享
err收藏
err分享
err收藏
err分享
err收藏
Malignant triton tumor in a patient with Li‐Fraumeni syndrome and a novel TP53 mutation
err2005-12-06
err0
errOAAI
errMwe Mwe Chao; John E. Levine; Robert E. Ruiz; Wendy K. Kohlmann; Matthew A. Bower; Elizabeth M. Petty; Rajen J. Mody
err分享
err收藏
Application of Plasma Electrolytic Oxidation Coating on Powder Metallurgy Ti-6Al-4V for Dental Implants
err2020-08-30
err0
errOAAI
errCristina Garcia-Cabezón; María Luz Rodriguez-Mendez; Vicente Amigo Borrás; Bayon Raquel; Jose Carlos Rodriguez Cabello; Arturo Ibañez Fonseca; Fernando Martin-Pedrosa
err分享
err收藏
err分享
err收藏
学者 查看更多内容