返回
RELAX: Representation Learning Explainability
DOI:10.1007/s11263-023-01773-2.png)
摘要
En 中文
Despite the significant improvements that self-supervised representation learning has led to when learning from unlabeled data, no methods have been developed that explain what influences the learned representation. We address this need through our proposed approach, RELAX, which is the first approach for attribution-based explanations of representations. Our approach can also model the uncertainty in its explanations, which is essential to produce trustworthy explanations. RELAX explains representations by measuring similarities in the representation space between an input and masked out versions of itself, providing intuitive explanations that significantly outperform the gradient-based baselines. We provide theoretical interpretations of RELAX and conduct a novel analysis of feature extractors trained using supervised and unsupervised learning, providing insights into different learning strategies. Moreover, we conduct a user study to assess how well the proposed approach aligns with human intuition and show that the proposed method outperforms the baselines in both the quantitative and human evaluation studies. Finally, we illustrate the usability of RELAX in several use cases and highlight that incorporating uncertainty can be essential for providing faithful explanations, taking a crucial step towards explaining representations.
Keyword:
Representation learning
Explainability
Uncertainty
Self-supervised learning
期刊
IF:
9.3
论文数:
3.9K
被引数:
2.8W
机构
引用论文
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications解释深度神经网络及其以后: 方法和应用综述
PROCEEDINGS OF THE IEEE
IF25.9
Uncertainty and interpretability in convolutional neural networks for semantic segmentation of colorectal polyps卷积神经网络用于结直肠息肉语义分割的不确定性和可解释性
MEDICAL IMAGE ANALYSIS
IF11.8
Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability具有磁和光学双稳态的自旋交叉,互穿网络中具有变构效应的晶态反应
Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median检测异常值: 不使用平均值周围的标准偏差,使用中位数周围的绝对偏差
Cell-free Protein Synthesis in an Autoinduction System for NMR Studies of Protein–Protein Interactions用于NMR研究蛋白质-蛋白质相互作用的自动诱导系统中的无细胞蛋白质合成
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系?

