返回
Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges
DOI:10.1145/3453444.png)
摘要
En 中文
Machine learning has evolved into an enabling technology for a wide range of highly successful applications. The potential for this success to continue and accelerate has placed machine learning (ML) at the top of research, economic, and political agendas. Such unprecedented interest is fuelled by a vision of ML applicability extending to healthcare, transportation, defence, and other domains of great societal importance. Achieving this vision requires the use of ML in safety-critical applications that demand levels of assurance beyond those needed for current ML applications. Our article provides a comprehensive survey of the state of the art in the assurance of ML, i.e., in the generation of evidence that ML is sufficiently safe for its intended use. The survey covers the methods capable of providing such evidence at different stages of the machine learning lifecycle, i.e., of the complex, iterative process that starts with the collection of the data used to train anML component for a system, and ends with the deployment of that component within the system. The article begins with a systematic presentation of the ML lifecycle and its stages. We then define assurance desiderata for each stage, review existing methods that contribute to achieving these desiderata, and identify open challenges that require further research.
Keyword:
Machine learning lifecycle
machine learning workflow
safety-critical systems
assurance
assurance evidence
期刊
IF:
28
论文数:
2.4K
被引数:
3.5W
机构
引用论文
The Artificial Intelligence Clinician learns optimal treatment strategies for sepsis in intensive care人工智能临床医生学习重症监护脓毒症的最佳治疗策略
NATURE MEDICINE
IF50
Coalition game for user association and bandwidth allocation in ultra-dense mmWave networks超密集毫米波网络中用户关联和带宽分配的联盟博弈
Adaptive Energy Management Strategy Calibration in PHEVs Based on a Sensitivity Study基于灵敏度研究的phev自适应能量管理策略标定

