返回
A metrological framework for uncertainty evaluation in machine learning classification models
DOI:10.1088/1681-7575/ae1bae.png)
摘要
En 中文
Machine learning (ML) classification models are increasingly being used in a wide range of applications where it is important that predictions are accompanied by uncertainties, including in climate and earth observation, medical diagnosis and bioaerosol monitoring. The output of an ML classification model is a type of categorical variable known as a nominal property in the International Vocabulary of Metrology (VIM). However, concepts related to uncertainty evaluation for nominal properties are not defined in the VIM, nor is such evaluation addressed by the guide to the expression of uncertainty in measurement (GUM). In this paper we propose a metrological conceptual uncertainty evaluation framework for nominal properties. This framework is based on probability mass functions and summary statistics thereof, and it is applicable to ML classification. We also illustrate its use in the context of two applications that exemplify the issues and have significant societal impact, namely, climate and earth observation and medical diagnosis. Our framework would enable an extension of the GUM to uncertainty for nominal properties, which would make both applicable to ML classification models.
Keyword:
classification
machine learning
uncertainty evaluation
nominal properties
期刊
M
IF:
2.4
论文数:
55
被引数:
4.2K
机构
引用论文
Uncertainty as a Predictor of Classification Accuracy in Machine Learning-Assisted Measurements [Measurement Methodology]测量方法学:不确定性作为机器学习辅助测量中分类准确性的预测因子
Mapping of ESA's Climate Change Initiative land cover data to plant functional types for use in the CLASSIC land model
BIOGEOSCIENCES
IF3.9

