arrow
返回

A metrological framework for uncertainty evaluation in machine learning classification models

delete2025-12-01
delete1
PRE
AI
S
Samuel Bilson
M
M G Cox
A
Anna Pustogvar
A
Andrew Thompson *
DOI:10.1088/1681-7575/ae1baedelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Machine learning (ML) classification models are increasingly being used in a wide range of applications where it is important that predictions are accompanied by uncertainties, including in climate and earth observation, medical diagnosis and bioaerosol monitoring. The output of an ML classification model is a type of categorical variable known as a nominal property in the International Vocabulary of Metrology (VIM). However, concepts related to uncertainty evaluation for nominal properties are not defined in the VIM, nor is such evaluation addressed by the guide to the expression of uncertainty in measurement (GUM). In this paper we propose a metrological conceptual uncertainty evaluation framework for nominal properties. This framework is based on probability mass functions and summary statistics thereof, and it is applicable to ML classification. We also illustrate its use in the context of two applications that exemplify the issues and have significant societal impact, namely, climate and earth observation and medical diagnosis. Our framework would enable an extension of the GUM to uncertainty for nominal properties, which would make both applicable to ML classification models.
Keyword:
classification
machine learning
uncertainty evaluation
nominal properties

期刊

M
Metrologia
IF:
2.4
论文数:
55
被引数:
4.2K

机构

N
national physical laboratory - uk
学者数:
2.0K
论文数: 1.9K
被引数: 2
引用论文

引用论文

Atrial fibrillation: epidemiology, screening and digital health心房颤动: 流行病学、筛查和数字健康
err2024-02-01
err40
errOAAI
errLinz, Dominik; Gawalko, Monika; Betz, Konstanze; Hendriks, Jeroen M.; Lip, Gregory Y. H.; Vinter, Nicklas; Guo, Yutao; Johnsen, Soren
err分享
err收藏
Mapping of ESA's Climate Change Initiative land cover data to plant functional types for use in the CLASSIC land model
err2023-06-20
err5
errOAAI
errWang, Libo; Arora, Vivek K.; Bartlett, Paul; Chan, Ed; Curasi, Salvatore R.
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容