arrow
Return

Fair prediction sets through multi-objective hyperparameter optimization

delete2025-01-17
delete0
delete
OA
AI
A
Alberto García‐Galindo *
M
Marcos López-De-Castro
R
Rubén Armañanzas
DOI:10.1007/s10994-024-06721-wdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The widespread implementation of machine learning in safety-critical domains has raised ethical concerns regarding algorithmic discrimination. In such settings, the integration of fairness-aware algorithms with uncertainty quantification tools enables the development of reliable and safe decision-making. In this paper, we introduce a novel methodology that combines conformal prediction, offering rigorous prediction sets, with multi-objective optimization via evolutionary learning. The proposed meta-algorithm optimizes the hyperparameter configuration of classifiers to produce confidence predictors that balance efficiency and equalized coverage guarantees, addressing fairness concerns related to sensitive attributes. We empirically evaluate our methodology with four real-world problems and demonstrate its efficacy in exploring this trade-off and producing a repertoire of Pareto optimal conformal predictors. In this way, our contribution offers different modeling alternatives from which to choose depending on the policy adopted by stakeholders, thus illustrating its capability to enhance equitable decision-making.
Keywords:
Conformal prediction
Algorithmic fairness
Equalized coverage
Multi-objective optimization
Uncertainty quantification

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

C
Clin Univ Navarra
Scholars:
462
Papers: 273
Citations: 67
Cited Papers

Cited Papers

A Review on Fairness in Machine Learning
err2022-02-03
err188
PREAI
errPessach, Dana; Shmueli, Erez
errShare
errSave
Dissecting racial bias in an algorithm used to manage the health of populations
errSCIENCE
IF45.8
err2019-10-25
err2.3K
errOAAI
errObermeyer, Ziad; Powers, Brian; Vogeli, Christine; Mullainathan, Sendhil
errShare
errSave
Inductive Confidence Machines for Regression
err2002-09-20
err0
errOAAI
errHarris Papadopoulos; Kostas Proedrou; Volodya Vovk; Alex Gammerman
errShare
errSave
Impact of HbA1c Measurement on Hospital Readmission Rates: Analysis of 70,000 Clinical Database Patient Records
err2014-01-01
err0
errOAAI
errBeata Strack; Jonathan P. DeShazo; Chris Gennings; Juan L. Olmo; Sebastian Ventura; Krzysztof J. Cios; John N. Clore
errShare
errSave
With Malice Toward None: Assessing Uncertainty via Equalized Coverage
err2020-04-30
err0
errOAAI
errYaniv Romano; Rina Foygel Barber; Chiara Sabatti; Emmanuel Candès
errShare
errSave
Uncertainty in Machine Learning: A Safety Perspective on Autonomous Driving
err2018-08-21
err0
PREAI
errSina Shafaei; Stefan Kugele; Mohd Hafeez Osman; Alois Knoll
errShare
errSave
Uncertainty aware training to improve deep learning model calibration for classification of cardiac MR images
err2023-08-01
err4
errOAAI
errDawood, Tareen; Chen, Chen; Sidhu, Baldeep S.; Ruijsink, Bram; Gould, Justin; Porter, Bradley; Elliott, Mark K.; Mehta, Vishal; Rinaldi, Christopher A.; Puyol-Anton, Esther; Razavi, Reza; King, Andrew P.
errShare
errSave
researcher View more