arrow
Return

Uplift modeling with value-driven evaluation metrics

delete2021-11-01
delete9
PRE
AI
R
Robin M. Gubela *
S
Stefan Lessmann
DOI:10.1016/j.dss.2021.113648delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Measuring the success of targeted marketing actions is challenging. Research on prescriptive analytics recommends uplift models to guide targeting decisions. Uplift models predict how much a marketing action will change customers' behavior, known as the individual treatment effect (ITE). Marketers can then solicit customers in decreasing order of their estimated ITE. We argue that the ITE-based targeting policy is not fully consistent with a business value maximization objective. We propose business-centric evaluation metrics that integrate estimates of the ITE and the expected business value and validate their benefits relative to the ITE-based targeting baseline using real-world marketing data. The new metrics yield remarkably higher profit across different uplift models, targeting depths, profit functions, and data sets. They further contribute to the growing field of interpretable data science by uncovering interdependencies between covariates, ITE, and profit and by clarifying whether customers are worth targeting because of high responsiveness or high value.
Keywords:
Interpretable data science
Uplift modeling
Evaluation metric
Target marketing

Journal

Decision Support Systems cover
Decision Support Systems
IF:
6.8
Papers:
3.8K
Citations:
1.5W

Organization

H
Humboldt University of Berlin
Scholars:
3.2W
Papers: 2.7W
Citations: 47