arrow
Return

Conformalized classifiers with reject option

delete2026-01-01
delete0
delete
OA
AI
U
Ulf Johansson *
C
Cecilia Sönströd
DOI:10.1016/j.mlwa.2026.100838delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In data-driven decision support, predictive models built using machine learning aid in making informed decisions. In this context, models with a reject option may refrain from making predictions for certain instances. Accurately assessing the trade-off between predictive performance and throughput requires the ability to estimate performance at different rejection levels in advance. In this paper, we demonstrate how conformal prediction can be used for this purpose. Under exchangeability, the proposed conformalized classifiers can perfectly estimate accuracy or precision for any rejection level. In an empirical investigation using 41 publicly available datasets, the conformalized classifiers with a reject option are shown to clearly outperform probabilistic predictors calibrated with state-of-the-art techniques.
Keywords:
Conformal prediction
Classification
Classification with reject option
Precision
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

M
Machine Learning with Applications
IF:
4.9
Papers:
135
Citations:
0

Organization

J
Jonkoping University
Scholars:
232
Papers: 132
Citations: 16