arrow
Return

Explaining Cross-domain Recognition with Interpretable Deep Classifier

delete2023-10-23
delete0
delete
OA
AI
Y
Yiheng Zhang
T
Ting Yao *
Z
Zhaofan Qiu
T
Tao Mei
DOI:10.1145/3623399delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The recent advances in deep learning predominantly construct models in their internal representations, and it is opaque to explain the rationale behind and decisions to human users. Such explainability is especially essential for domain adaptation, whose challenges require developing more adaptive models across different domains. In this article, we ask the question: How much does each sample in the source domain contribute to the network's prediction on the samples from the target domain? To address this, we devise a novel Interpretable Deep Classifier (IDC) that learns the nearest source samples of a target sample as evidence upon which the classifier makes the decision. Technically, IDC maintains a differentiable memory bank for each category, and the memory slot derives a form of key-value pair. The key records the features of discriminative source samples, and the value stores the corresponding properties, e.g., representative scores of the features for describing the category. IDC computes the loss between the output of IDC and the labels of source samples to back-propagate to adjust the representative scores and update the memory banks. Extensive experiments on Office-Home and VisDA-2017 datasets demonstrate that our IDC leads to a more explainable model with almost no accuracy degradation and effectively calibrates classification for optimum reject options. More remarkably, when taking IDC as a prior interpreter, capitalizing on 0.1% source training data selected by IDC still yields superior results than that uses full training set on VisDA-2017 for unsupervised domain adaptation.
Keywords:
Explainable
unsupervised domain adaptation
memory matching

Journal

ACM Transactions on Multimedia Computing Communications and Applications cover
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
Papers:
2.0K
Citations:
5.4K

Organization

No organization information available
Cited Papers

Cited Papers

Weighted and Class-Specific Maximum Mean Discrepancy for Unsupervised Domain Adaptation
err2020-09-01
err69
PREAI
errYan, Hongliang; Li, Zhetao; Wang, Qilong; Li, Peihua; Xu, Yong; Zuo, Wangmeng
errShare
errSave
Top-Down Neural Attention by Excitation Backprop
err2017-12-23
err413
PREAI
errZhang, Jianming; Bargal, Sarah Adel; Lin, Zhe; Brandt, Jonathan; Shen, Xiaohui; Sclaroff, Stan
errShare
errSave
Dimensioning Methodology of an Energy Storage System Based on Supercapacitors for Grid Code Compliance of a Wave Power Plant
err2021-02-13
err0
errOAAI
errGustavo Navarro; Marcos Blanco; Jorge Torres; Jorge Nájera; Álvaro Santiago; Miguel Santos-Herran; Dionisio Ramírez; Marcos Lafoz
errShare
errSave
Faster Domain Adaptation Networks
err2022-12-01
err74
PREAI
errLi, Jingjing; Jing, Mengmeng; Su, Hongzu; Lu, Ke; Zhu, Lei; Shen, Heng Tao
errShare
errSave
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI
err2020-06-01
err3.9K
errOAAI
errBarredo Arrieta, Alejandro; Diaz-Rodriguez, Natalia; Del Ser, Javier; Bennetot, Adrien; Tabik, Siham; Barbado, Alberto; Garcia, Salvador; Gil-Lopez, Sergio; Molina, Daniel; Benjamins, Richard; Chatila, Raja; Herrera, Francisco
errShare
errSave
Cross-Domain Contrastive Learning for Unsupervised Domain Adaptation
err2023-01-01
err77
errOAAI
errWang, Rui; Wu, Zuxuan; Weng, Zejia; Chen, Jingjing; Qi, Guo-Jun; Jiang, Yu-Gang
errShare
errSave
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
err2019-10-11
err8.0K
errOAAI
errSelvaraju, Ramprasaath R.; Cogswell, Michael; Das, Abhishek; Vedantam, Ramakrishna; Parikh, Devi; Batra, Dhruv
errShare
errSave
Learning Reliable Visual Saliency For Model Explanations
err2020-07-01
err24
PREAI
errWang, Yulong; Su, Hang; Zhang, Bo; Hu, Xiaolin
errShare
errSave
Excitation Dropout: Encouraging Plasticity in Deep Neural Networks
err2021-01-09
err12
errOAAI
errZunino, Andrea; Bargal, Sarah Adel; Morerio, Pietro; Zhang, Jianming; Sclaroff, Stan; Murino, Vittorio
errShare
errSave
no more