arrow
Return

Fair human-centric image dataset for ethical AI benchmarking

delete2025-11-05
delete0
delete
OA
AI
A
Alice Xiang *
J
Jerone T. A. Andrews
R
Rebecca L. Bourke
W
William Thong
J
Julienne LaChance
T
Tiffany Georgievski
A
Apostolos Modas
A
Aida Rahmattalabbi
Y
Yunhao Ba
S
Shruti Nagpal
O
Orestis Papakyriakopoulos
D
Dora Zhao
J
Jinru Xue
V
Victoria Matthews
L
Linxia Gong
A
Austin Hoag
M
Mircea Cimpoi
S
Swami Sankaranarayanan
W
Wiebke Hutiri
M
Morgan Klaus Scheuerman
A
Albert S. Abedi
P
Peter Stone
P
Peter R. Wurman
H
Hiroaki Kitano
M
Michael Spranger
DOI:10.1038/s41586-025-09716-2delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Computer vision is central to many artificial intelligence (AI) applications, from autonomous vehicles to consumer devices. However, the data behind such technical innovations are often collected with insufficient consideration of ethical concerns1–3. This has led to a reliance on datasets that lack diversity, perpetuate biases and are collected without the consent of data rights holders. These datasets compromise the fairness and accuracy of AI models and disenfranchise stakeholders4–8. Although awareness of the problems of bias in computer vision technologies, particularly facial recognition, has become widespread9, the field lacks publicly available, consensually collected datasets for evaluating bias for most tasks3,10,11. In response, we introduce the Fair Human-Centric Image Benchmark (FHIBE, pronounced ‘Feebee’), a publicly available human image dataset implementing best practices for consent, privacy, compensation, safety, diversity and utility. FHIBE can be used responsibly as a fairness evaluation dataset for many human-centric computer vision tasks, including pose estimation, person segmentation, face detection and verification, and visual question answering. By leveraging comprehensive annotations capturing demographic and physical attributes, environmental factors, instrument and pixel-level annotations, FHIBE can identify a wide variety of biases. The annotations also enable more nuanced and granular bias diagnoses, enabling practitioners to better understand sources of bias and mitigate potential downstream harms. FHIBE therefore represents an important step forward towards trustworthy AI, raising the bar for fairness benchmarks and providing a road map for responsible data curation in AI. The Fair Human-Centric Image Benchmark (FHIBE, pronounced ‘Feebee’)—an image dataset that implements best practices for consent, privacy, compensation, safety, diversity and utility—can be used responsibly as a fairness evaluation dataset for many human-centric computer vision applications.
Keywords:
Fair Human-Centric Image Benchmark
Ethical AI
Dataset Bias
Computer Vision
Responsible Data Curation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature cover
Nature
IF:
48.5
Papers:
1.8W
Citations:
96.5W

Organization

S
Sony AI
Scholars:
67
Papers: 4
Citations: 0