arrow
返回

Visual Explanation for Deep Metric Learning

delete2021-01-01
delete17
delete
OA
AI
Z
Zhu, Sijie
T
Taojiannan Yang
C
Chen Chen *
DOI:10.1109/TIP.2021.3107214delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This work explores the visual explanation for deep metric learning and its applications. As an important problem for learning representation, metric learning has attracted much attention recently, while the interpretation of the metric learning model is not as well-studied as classification. To this end, we propose an intuitive idea to show where contributes the most to the overall similarity of two input images by decomposing the final activation. Instead of only providing the overall activation map of each image, we propose to generate point-to-point activation intensity between two images so that the relationship between different regions is uncovered. We show that the proposed framework can be directly applied to a wide range of metric learning applications and provides valuable information for model understanding. Both theoretical and empirical analyses are provided to demonstrate the superiority of the proposed overall activation map over existing methods. Furthermore, our experiments validate the effectiveness of the proposed point-specific activation map on two applications, i.e. cross-view pattern discovery and interactive retrieval. Code is available at https://github.com/Jeff-Zilence/Explain_Metric_Learning
Keyword:
Measurement
Computer architecture
Visualization
Mouth
Image retrieval
Computational modeling
Perturbation methods
Deep metric learning
visual explanation
convolutional neural networks
activation decomposition

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

State University System of Florida 封面图
State University System of Florida
学者数:
12.8W
论文数: 10.9W
被引数: 130
引用论文

引用论文

Client ahead‐of‐time compiler for embedded Java platforms
err2008-08-05
err0
PREAI
errSunghyun Hong; Jin‐Chul Kim; Soo‐Mook Moon; Jin Woo Shin; Jaemok Lee; Hyeong‐Seok Oh; Hyung‐Kyu Choi
err分享
err收藏
err分享
err收藏
Implementing a strategy successfully
err2001-12-01
err0
PREAI
errJoseph A. De Feo; Alexander Janssen
err分享
err收藏
Metagenomic assessment of adventitious viruses in commercial bovine sera
err2017-05-01
err0
PREAI
errKathy Toohey-Kurth; Samuel D. Sibley; Tony L. Goldberg
err分享
err收藏
Top-Down Neural Attention by Excitation Backprop自上而下的神经注意力通过激励背prop
err2017-12-23
err413
PREAI
errZhang, Jianming; Bargal, Sarah Adel; Lin, Zhe; Brandt, Jonathan; Shen, Xiaohui; Sclaroff, Stan
err分享
err收藏
err分享
err收藏
err分享
err收藏
Assessing long‐term hydrologic effects of land use change
err1997-11-01
err0
PREAI
errBudhendra Bhaduri; Matt Grove; Carmen Lowry; Jon Harbor
err分享
err收藏
学者 查看更多内容