arrow
返回

Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges

delete2021-05-25
delete106
delete
OA
AI
R
Rob Ashmore *
R
Radu Călinescu
C
Colin Paterson
DOI:10.1145/3453444delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Machine learning has evolved into an enabling technology for a wide range of highly successful applications. The potential for this success to continue and accelerate has placed machine learning (ML) at the top of research, economic, and political agendas. Such unprecedented interest is fuelled by a vision of ML applicability extending to healthcare, transportation, defence, and other domains of great societal importance. Achieving this vision requires the use of ML in safety-critical applications that demand levels of assurance beyond those needed for current ML applications. Our article provides a comprehensive survey of the state of the art in the assurance of ML, i.e., in the generation of evidence that ML is sufficiently safe for its intended use. The survey covers the methods capable of providing such evidence at different stages of the machine learning lifecycle, i.e., of the complex, iterative process that starts with the collection of the data used to train anML component for a system, and ends with the deployment of that component within the system. The article begins with a systematic presentation of the ML lifecycle and its stages. We then define assurance desiderata for each stage, review existing methods that contribute to achieving these desiderata, and identify open challenges that require further research.
Keyword:
Machine learning lifecycle
machine learning workflow
safety-critical systems
assurance
assurance evidence

期刊

ACM Computing Surveys 封面图
ACM Computing Surveys
IF:
28
论文数:
2.4K
被引数:
3.5W

机构

D
defence science and technology laboratory
学者数:
720
论文数: 619
被引数: 4
U
university of york - uk
学者数:
1.5W
论文数: 1.5W
被引数: 15
引用论文

引用论文

A unifying view on dataset shift in classification关于分类中数据集移位的统一观点
err2012-01-01
err611
PREAI
errMoreno-Torres, Jose G.; Raeder, Troy; Alaiz-Rodriguez, Rocio; Chawla, Nitesh V.; Herrera, Francisco
err分享
err收藏
LigRMSD: a web server for automatic structure matching and RMSD calculations among identical and similar compounds in protein-ligand docking
err2020-01-11
err0
errOAAI
errJosé Luis Velázquez-Libera; Fabio Durán-Verdugo; Alejandro Valdés-Jiménez; Gabriel Núñez-Vivanco; Julio Caballero
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容