arrow
Return

A proposal for developing a platform that evaluates algorithmic equity and accuracy

delete2022-04-11
delete16
delete
OA
AI
P
Paul Cerrato *
J
John Halamka
M
Michael Pencina
DOI:10.1136/bmjhci-2021-100423delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We are at a pivotal moment in the development of healthcare artificial intelligence (AI), a point at which enthusiasm for machine learning has not caught up with the scientific evidence to support the equity and accuracy of diagnostic and therapeutic algorithms. This proposal examines algorithmic biases, including those related to race, gender and socioeconomic status, and accuracy, including the paucity of prospective studies and lack of multisite validation. We then suggest solutions to these problems. We describe the Mayo Clinic, Duke University, Change Healthcare project that is evaluating 35.1 billion healthcare records for bias. And we propose 'Ingredients' style labels and an AI evaluation/testing system to help clinicians judge the merits of products and services that include algorithms. Said testing would include input data sources and types, dataset population composition, algorithm validation techniques, bias assessment evaluation and performance metrics.
Keywords:
artificial intelligence
BMJ health informatics
decision making
computer-assisted
deep learning
informatics
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

B
BMJ Health and Care Informatics
IF:
4.4
Papers:
354
Citations:
1.1K

Organization

D
Duke University
Scholars:
6.3W
Papers: 5.7W
Citations: 6.5W
M
mayo clinic
Scholars:
8.3W
Papers: 6.6W
Citations: 85
Cited Papers

Cited Papers

Dissecting racial bias in an algorithm used to manage the health of populations
errSCIENCE
IF45.8
err2019-10-25
err2.3K
errOAAI
errObermeyer, Ziad; Powers, Brian; Vogeli, Christine; Mullainathan, Sendhil
errShare
errSave
Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension
err2020-09-09
err340
errOAAI
errLiu, Xiaoxuan; Rivera, Samantha Cruz; Moher, David; Calvert, Melanie J.; Denniston, Alastair K.
errShare
errSave
Prediction Models - Development, Evaluation, and Clinical Application
err2020-04-23
err77
PREAI
errPencina, Michael J.; Goldstein, Benjamin A.; D'Agostino, Ralph B.
errShare
errSave
How medical AI devices are evaluated: limitations and recommendations from an analysis of FDA approvals
err2021-04-05
err234
PREAI
errWu, Eric; Wu, Kevin; Daneshjou, Roxana; Ouyang, David; Ho, Daniel E.; Zou, James
errShare
errSave
Current Clinical Applications of Artificial Intelligence in Radiology and Their Best Supporting Evidence
err2020-11-01
err37
PREAI
errTariq, Amara; Purkayastha, Saptarshi; Padmanaban, Geetha Priya; Krupinski, Elizabeth; Trivedi, Hari; Banerjee, Imon; Gichoya, Judy Wawira
errShare
errSave
2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines
err2014-06-24
err2.3K
errOAAI
errGoff, David C., Jr.; Lloyd-Jones, Donald M.; Bennett, Glen; Coady, Sean; D'Agostino, Ralph B.; Gibbons, Raymond; Greenland, Philip; Lackland, Daniel T.; Levy, Daniel; O'Donnell, Christopher J.; Robinson, Jennifer G.; Schwartz, J. Sanford; Shero, Susan T.; Smith, Sidney C., Jr.; Sorlie, Paul; Stone, Neil J.; Wilson, Peter W. F.
errShare
errSave
The Clinician and Dataset Shift in Artificial Intelligence
err2021-07-15
err308
errOAAI
errFinlayson, Samuel G.; Subbaswamy, Adarsh; Singh, Karandeep; Bowers, John; Kupke, Annabel; Zittrain, Jonathan; Kohane, Isaac S.; Saria, Suchi
errShare
errSave
Accelerated SLID bonding using thin multi-layer copper-solder stack for fine-pitch interconnections
err2014-05-01
err0
PREAI
errChinmay Honrao; Ting-Chia Huang; Makoto Kobayashi; Vanessa Smet; P. Markondeya Raj; Rao Tummala
errShare
errSave
Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension
err2020-09-09
err86
errOAAI
errRivera, Samantha Cruz; Liu, Xiaoxuan; Chan, An-Wen; Denniston, Alastair K.; Calvert, Melanie J.
errShare
errSave
A Generalizable, Data-Driven Approach to Predict Daily Risk of Clostridium difficile Infection at Two Large Academic Health Centers
err2018-03-26
err98
errOAAI
errOh, Jeeheh; Makar, Maggie; Fusco, Christopher; McCaffrey, Robert; Rao, Krishna; Ryan, Erin E.; Washer, Laraine; West, Lauren R.; Young, Vincent B.; Guttag, John; Hooper, David C.; Shenoy, Erica S.; Wiens, Jenna
errShare
errSave
researcher View more