arrow
Return

Statistical Tests for Replacing Human Decision Makers with Algorithms

delete2025-03-05
delete0
delete
OA
AI
F
Feng Kai
H
Han Hong
汤珂 (Ke Tang)
J
Jingyuan Wang *
DOI:10.1287/mnsc.2023.01845delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper proposes a statistical framework of using artificial intelligence to improve human decision making. The performance of each human decision maker is benchmarked against that of machine predictions. We replace the diagnoses made by a subset of the decision makers with the recommendation from the machine learning algorithm. We apply both a heuristic frequentist approach and a Bayesian posterior loss function approach to abnormal birth detection using a nationwide data set of doctor diagnoses from prepregnancy checkups of reproductive-age couples and pregnancy outcomes. We find that our algorithm on a test data set results in a higher overall true positive rate and a lower false positive rate than the diagnoses made by doctors only.
Keywords:
artificial intelligence
machine learning
decision making
ROC curve

Journal

Management Science cover
Management Science
IF:
4.9
Papers:
780
Citations:
5.0W

Organization

No organization information available