.png){kind=icon}
Return
RELAX: Representation Learning Explainability
.png){kind=icon}
OA
AI
DOI：10.1007/s11263-023-01773-2.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Despite the significant improvements that self-supervised representation learning has led to when learning from unlabeled data, no methods have been developed that explain what influences the learned representation. We address this need through our proposed approach, RELAX, which is the first approach for attribution-based explanations of representations. Our approach can also model the uncertainty in its explanations, which is essential to produce trustworthy explanations. RELAX explains representations by measuring similarities in the representation space between an input and masked out versions of itself, providing intuitive explanations that significantly outperform the gradient-based baselines. We provide theoretical interpretations of RELAX and conduct a novel analysis of feature extractors trained using supervised and unsupervised learning, providing insights into different learning strategies. Moreover, we conduct a user study to assess how well the proposed approach aligns with human intuition and show that the proposed method outperforms the baselines in both the quantitative and human evaluation studies. Finally, we illustrate the usability of RELAX in several use cases and highlight that incorporating uncertainty can be essential for providing faithful explanations, taking a crucial step towards explaining representations.
Keywords:
Representation learning
Explainability
Uncertainty
Self-supervised learning
Journal
IF:
9.3
Papers:
3.9K
Citations:
2.8W
Organization
Cited Papers
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications.png)
PROCEEDINGS OF THE IEEE
OAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAIShareSaveUncertainty and interpretability in convolutional neural networks for semantic segmentation of colorectal polypsMEDICAL IMAGE ANALYSISOAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAIShareSaveShareSaveShareSaveShareSaveShareSave
View more