.png){kind=icon}
Return
Explaining predictive uncertainty by exposing second-order effects
.png){kind=icon}
OA
AI
DOI：10.1016/j.patcog.2024.111171.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Explainable AI has brought transparency to complex ML black boxes, enabling us, in particular, to identify which features these models use to make predictions. So far, the question of how to explain predictive uncertainty, i.e., why a model 'doubts', has been scarcely studied. Our investigation reveals that predictive uncertainty is dominated by second-order effects, involving single features or product interactions between them. We contribute a new method for explaining predictive uncertainty based on these second-order effects. Computationally, our method reduces to a simple covariance computation over a collection of first-order explanations. Our method is generally applicable, allowing for turning common attribution techniques (LRP, Gradient x Input, etc.) into powerful second-order uncertainty explainers, which we call CovLRP, CovGI, etc. The accuracy of the explanations our method produces is demonstrated through systematic quantitative evaluations, and the overall usefulness of our method is demonstrated through two practical showcases.
Keywords:
Explainable AI
Predictive uncertainty
Ensemble models
Second-order attribution
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
View more organizations
Cited Papers
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications.png)
PROCEEDINGS OF THE IEEEOAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAIShareSaveFinding the input features that reduce the entropy of a neural network's predictionAPPLIED INTELLIGENCE
OAAI
APPLIED INTELLIGENCEIF3.5
OAAIShareSaveShareSaveShareSaveShareSaveConfidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image SegmentationOAAI
OAAIShareSaveShareSaveShareSave View more