arrow
Return

Data Pre-Processing for Discrimination Prevention: Information-Theoretic Optimization and Analysis

delete2018-10-01
delete21
PRE
AI
C
Calmon, Flavio du Pin *
D
Dennis Wei
B
Bhanukiran Vinzamuri
K
Karthikeyan Natesan Ramamurthy
K
Kush R. Varshney
DOI:10.1109/JSTSP.2018.2865887delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Non-discrimination is a recognized objective in algorithmic decision making. In this paper, we introduce a novel probabilistic formulation of data pre-processing for reducing discrimination. We propose a convex optimization for learning a data transformation with three goals: controlling group discrimination, limiting distortion in individual data samples, and preserving utility. Several theoretical properties are established, including conditions for convexity, a characterization of the impact of limited sample size on discrimination and utility guarantees, and a connection between discrimination and estimation. Two instances of the proposed optimization are applied to datasets, including one on real-world criminal recidivism. Results show that discrimination can be greatly reduced at a small cost in classification accuracy and with precise control of individual distortion.
Keywords:
Machine learning
ethics
optimization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Journal of Selected Topics in Signal Processing cover
IEEE Journal of Selected Topics in Signal Processing
IF:
13.7
Papers:
1.9K
Citations:
1.1W

Organization

H
Harvard University
Scholars:
26.5W
Papers: 22.0W
Citations: 28.7W