arrow
返回

RELAX: Representation Learning Explainability

delete2023-03-11
delete4
delete
OA
AI
K
Kristoffer Wickstrøm *
D
Daniel J. Trosten
S
Sigurd Løkse
A
Ahcène Boubekki
K
Karl Øyvind Mikalsen
M
Michael Kampffmeyer
R
Robert Jenssen
DOI:10.1007/s11263-023-01773-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Despite the significant improvements that self-supervised representation learning has led to when learning from unlabeled data, no methods have been developed that explain what influences the learned representation. We address this need through our proposed approach, RELAX, which is the first approach for attribution-based explanations of representations. Our approach can also model the uncertainty in its explanations, which is essential to produce trustworthy explanations. RELAX explains representations by measuring similarities in the representation space between an input and masked out versions of itself, providing intuitive explanations that significantly outperform the gradient-based baselines. We provide theoretical interpretations of RELAX and conduct a novel analysis of feature extractors trained using supervised and unsupervised learning, providing insights into different learning strategies. Moreover, we conduct a user study to assess how well the proposed approach aligns with human intuition and show that the proposed method outperforms the baselines in both the quantitative and human evaluation studies. Finally, we illustrate the usability of RELAX in several use cases and highlight that incorporating uncertainty can be essential for providing faithful explanations, taking a crucial step towards explaining representations.
Keyword:
Representation learning
Explainability
Uncertainty
Self-supervised learning

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

U
uit the arctic university of tromso
学者数:
9.8K
论文数: 8.6K
被引数: 10
引用论文

引用论文

Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications解释深度神经网络及其以后: 方法和应用综述
err2021-03-01
err575
errOAAI
errSamek, Wojciech; Montavon, Gregoire; Lapuschkin, Sebastian; Anders, Christopher J.; Mueller, Klaus-Robert
err分享
err收藏
Top-Down Neural Attention by Excitation Backprop自上而下的神经注意力通过激励背prop
err2017-12-23
err413
PREAI
errZhang, Jianming; Bargal, Sarah Adel; Lin, Zhe; Brandt, Jonathan; Shen, Xiaohui; Sclaroff, Stan
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容