arrow
返回

Finding the Best Classification Threshold in Imbalanced Classification

delete2016-09-01
delete192
PRE
AI
Q
Quan Zou
Z
Ziyu Lin
M
Meihong Wu
Y
Ying Ju *
DOI:10.1016/j.bdr.2015.12.001delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Classification with imbalanced class distributions is a major problem in machine learning. Researchers have given considerable attention to the applications in many real-world scenarios. Although several works have utilized the area under the receiver operating characteristic (ROC) curve to select potentially optimal classifiers in imbalanced classifications, limited studies have been devoted to finding the classification threshold for testing or unknown datasets. In general, the classification threshold is simply set to 0.5, which is usually unsuitable for an imbalanced classification. In this study, we analyze the drawbacks of using ROC as the sole measure of imbalance in data classification problems. In addition, a novel framework for finding the best classification threshold is proposed. Experiments with SCOP v.1.53 data reveal that, with the default threshold set to 0.5, our proposed framework demonstrated a 20.63% improvement in terms of F-score compared with that of more commonly used methods. The findings suggest that the proposed framework is both effective and efficient. A web server and software tools are available via http://datamining.xmu.edu.cn/prht/orhttp://prht.sinaapp.com/. (C) 2016 Elsevier Inc. All rights reserved.
Keyword:
Receiver Operating Characteristic (ROC)
Protein remote homology detection
Imbalance data
F-score

期刊

Big Data Research 封面图
Big Data Research
IF:
4.2
论文数:
416
被引数:
1.1K

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
X
xiamen university
学者数:
5.9W
论文数: 3.8W
被引数: 67
引用论文

引用论文

scDD: A statistical approach for identifying differential distributions in single-cell RNA-seq experiments
err
IF0
err2015-12-29
err0
errOAAI
errKeegan D. Korthauer; Li-Fang Chu; Michael A. Newton; Yuan Li; James Thomson; Ron Stewart; Christina Kendziorski
err分享
err收藏
Total synthesis of manoalide and seco-manoalide
err1985-01-01
err0
PREAI
errShigeo Katsumura; Shinya Fujiwara; Sachihiko Isoe
err分享
err收藏
Clinical-Performance Remediation Program for Dyscompetent Medical Students
err2013-06-30
err0
errOAAI
errSun Jung Myung; Jae-June Yim; Sang Min Park; Jwa Seop Shin
err分享
err收藏
Pse-in-One: a web server for generating various modes of pseudo components of DNA, RNA, and protein sequences
err2015-05-09
err705
errOAAI
errLiu, Bin; Liu, Fule; Wang, Xiaolong; Chen, Junjie; Fang, Longyun; Chou, Kuo-Chen
err分享
err收藏
Implementation of Arithmetic Operations With Time-Free Spiking Neural P Systems
err2015-09-01
err53
PREAI
errLiu, Xiangrong; Li, Ziming; Liu, Juan; Liu, Logan; Zeng, Xiangxiang
err分享
err收藏
学者 查看更多内容