arrow
返回

Threshold prediction for detecting rare positive samples using a meta-learner

delete2022-09-14
delete2
PRE
AI
H
Hossein Ghaderi Zefrehi *
G
Ghazaal Sheikhi
H
Hakan Altınçay
DOI:10.1007/s10044-022-01103-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Threshold-moving is one of the several techniques employed in correcting the bias of binary classifiers towards the majority class. In this approach, the decision threshold is adjusted to detect the minority class at the cost of increased misclassification of the majority. In practice, selecting a good threshold using cross-validation on the training data is not feasible in some problems since there are only a few minority samples. In this study, building a meta-learner for threshold prediction to tackle the threshold estimation problem in the case of rare positive samples is addressed. Novel meta-features are suggested to quantify the imbalance characteristics of the data sets and the patterns among the prediction scores. A random forest-based threshold prediction model is constructed using these meta-features extracted from the score space of external data. The models obtained are then employed to estimate the optimal thresholds for previously unseen datasets. The random forest-based meta-learner that employs implicitly selected subset of the proposed meta-features and encodes information from multiple external sources in the form of different trees is evaluated by using 52 imbalanced datasets. In the first set of experiments, the best-fitting thresholds are computed for SVM and logistic regression classifiers that are trained using the original imbalanced training sets. The experiments are repeated by using ensembles of multiple learners, each trained using a different balanced data set. It is observed that the proposed approach provides better F-score when compared to alternative threshold-moving and balancing techniques.
Keyword:
Imbalance learning
Thresholding
Classifier ensembles
Balancing
Binary classification

期刊

Pattern Analysis and Applications 封面图
Pattern Analysis and Applications
IF:
2
论文数:
1.9K
被引数:
1.9K

机构

U
university of bergen
学者数:
2.0W
论文数: 1.7W
被引数: 19
E
Eastern Mediterranean University
学者数:
1.7K
论文数: 1.8K
被引数: 2.0K
引用论文

引用论文

Combustor Miniaturization with Liquid-Fuel Filming
err2003-11-11
err0
PREAI
errSimone Stanchi; Derek Dunn-Rankin; William Sirignano
err分享
err收藏
Seed oils fromCitrus sinensis
err1963-12-01
err0
PREAI
errR. Hendrickson; J. W. Kesterson
err分享
err收藏
err分享
err收藏
Multi label classifiers with a probabilistic thresholding strategy
err2012-02-01
err58
errOAAI
errRamon Quevedo, Jose; Luaces, Oscar; Bahamonde, Antonio
err分享
err收藏
A comprehensive data level analysis for cancer diagnosis on imbalanced data
err2019-02-01
err194
PREAI
errFotouhi, Sara; Asadi, Shahrokh; Kattan, Michael W.
err分享
err收藏
Mineral composition of fruit by-products evaluated by neutron activation analysis
err2013-01-13
err0
PREAI
errGabriela de Matuoka e Chiocchetti; Elisabete A. De Nadai Fernandes; Márcio Arruda Bacchi; Rogério Augusto Pazim; Silvana Regina Vicino Sarriés; Thaís Melega Tomé
err分享
err收藏
Saline with benzyl alcohol as intradermal anesthesia for intravenous line placement in children
err1998-04-01
err0
PREAI
errJOEL A. FEIN; CHRIS R. BOARDMAN; SUE STEVENSON; STEVEN M. SELBST
err分享
err收藏
学者 查看更多内容