arrow
Return

Contrastive counterfactual visual explanations with overdetermination

delete2023-05-17
delete1
delete
OA
AI
A
Adam White
N
Ngan, Kwun Ho *
J
J.J. Phelan
K
Kevin M. Ryan
S
Saman Sadeghi Afgeh
C
Constantino Carlos Reyes‐Aldasoro
A
Artur d’Avila Garcez
DOI:10.1007/s10994-023-06333-wdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A novel explainable AI method called CLEAR Image is introduced in this paper. CLEAR Image is based on the view that a satisfactory explanation should be contrastive, counterfactual and measurable. CLEAR Image seeks to explain an image's classification probability by contrasting the image with a representative contrast image, such as an auto-generated image obtained via adversarial learning. This produces a salient segmentation and a way of using image perturbations to calculate each segment's importance. CLEAR Image then uses regression to determine a causal equation describing a classifier's local input-output behaviour. Counterfactuals are also identified that are supported by the causal equation. Finally, CLEAR Image measures the fidelity of its explanation against the classifier. CLEAR Image was successfully applied to a medical imaging case study where it outperformed methods such as Grad-CAM and LIME by an average of 27% using a novel pointing game metric. CLEAR Image also identifies cases of causal overdetermination, where there are multiple segments in an image that are sufficient individually to cause the classification probability to be close to one.
Keywords:
Explainable AI
Counterfactual reasoning
Image classification
Overdetermination

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

C
city st georges, university of london
Scholars:
1.2W
Papers: 1.1W
Citations: 12