arrow
返回

A Robust profit measure for binary classification model evaluation

delete2018-02-01
delete18
delete
OA
AI
W
Wouter Verbeke
C
Cristián Bravo *
DOI:10.1016/j.eswa.2017.09.045delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Using profit-based evaluation measures is a necessity in business-oriented contexts, as they aid companies in making cost-optimal decisions. Among the measures that effectively include the true nature of costs and benefits in binary classification, the expected maximum profit (EMP) has been used successfully for churn prediction and credit scoring, and defined in general for binary classification problems. However, despite its competitive results against the most frequently used measures, the EMP relies on a fixed probability distribution of costs and benefits, the range of which in real applications is not entirely known. In this paper, we propose to extend this measure by adding random shocks to these distributions. We call this new measure the R-EMP, following the convention of the analogous EMP measure. Our metric adds a stochastic component to each point of the cost-benefit distributions, assuming that costs and benefits have a fixed probability, but its distribution range is subject to an external shock, which can be different for each cost or benefit. The experimental set-up is focused on a credit scoring application using a dataset of a Chilean financial institution, with the attribute selection for a logistic regression being accomplished using the AUC, EMP, H-measure, and R-EMP as the selection criteria. The results indicate that the R-EMP measure is the most robust metric for achieving the greatest profit for the company under uncertain external conditions. (C) 2017 Elsevier Ltd. All rights reserved.
Keyword:
Supervised binary classification
Business analytics
Performance measures
Profit-driven analytics
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

U
university of southampton
学者数:
3.3W
论文数: 3.2W
被引数: 52
U
universidad de talca
学者数:
2.5K
论文数: 2.4K
被引数: 1
V
Vrije Universiteit Brussel
学者数:
1.4W
论文数: 1.3W
被引数: 129
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
学者 查看更多内容