.png){kind=icon}
返回
Nested cross-validation when selecting classifiers is overzealous for most practical applications
.png){kind=icon}
OA
AI
DOI：10.1016/j.eswa.2021.115222.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
When selecting a classification algorithm to be applied to a particular problem, one has to simultaneously select the best algorithm for that dataset and the best set of hyperparameters for the chosen model. The usual approach is to apply a nested cross-validation procedure: hyperparameter selection is performed in the inner cross-validation, while the outer cross-validation computes an unbiased estimate of the expected accuracy of the algorithm with cross-validation based hyperparameter tuning. The alternative approach, which we shall call flat cross-validation, uses a single cross-validation step both to select the optimal hyperparameter values and to provide an estimate of the expected accuracy of the algorithm that, while biased, may nevertheless still be used to select the best learning algorithm. We tested both procedures using 12 different algorithms on 115 real-life binary datasets and conclude that using the less computationally costly flat cross-validation procedure will generally result in the selection of an algorithm that is, for all practical purposes, of similar quality to that selected via nested cross-validation, provided the learning algorithms have relatively few hyperparameters to be optimised.
Keyword:
Hyperparameters
Classification
cross-validation
Nested cross-validation
Model selection
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
Adaptive Impedance Control to Enhance Human Skill on a Haptic Interface System自适应阻抗控制以增强触觉接口系统上的人类技能OAAI
OAAI分享收藏Strategy of cross-linked enzyme aggregates onto magnetic particles adapted to the green design of biocatalytic synthesis of glycerol carbonate适用于生物催化合成甘油碳酸酯绿色设计的磁性颗粒交联酶聚集体策略.png)
RSC Advances
RSC AdvancesIF0
PREAI
分享收藏
查看更多内容