arrow
Return

Dynamic Match Kernel with Deep Convolutional Features for Image Retrieval

delete2018-11-01
delete23
delete
OA
AI
J
Jufeng Yang
J
Jie Liang
H
Hui Shen
K
Kai Wang
P
Paul L. Rosin
M
Ming–Hsuan Yang *
DOI:10.1109/TIP.2018.2845136delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
For image retrieval methods based on bag of visual words, much attention has been paid to enhancing the discriminative powers of the local features. Although retrieved images are usually similar to a query in minutiae, they may be significantly different from a semantic perspective, which can be effectively distinguished by convolutional neural networks (CNN). Such images should not be considered as relevant pairs. To tackle this problem, we propose to construct a dynamic match kernel by adaptively calculating the matching thresholds between query and candidate images based on the pairwise distance among deep CNN features. In contrast to the typical static match kernel which is independent to the global appearance of retrieved images, the dynamic one leverages the semantical similarity as a constraint for determining the matches. Accordingly, we propose a semantic-constrained retrieval framework by incorporating the dynamic match kernel, which focuses on matched patches between relevant images and filters out the ones for irrelevant pairs. Furthermore, we demonstrate that the proposed kernel complements recent methods, such as hamming embedding, multiple assignment, local descriptors aggregation, and graph-based re-ranking, while it outperforms the static one under various settings on off-the-shelf evaluation metrics. We also propose to evaluate the matched patches both quantitatively and qualitatively. Extensive experiments on five benchmark data sets and large-scale distractors validate the merits of the proposed method against the state-of-the-art methods for image retrieval.
Keywords:
Content based image retrieval
semantic-constrained framework
deep representation
dynamic match kernel
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

C
Cardiff University
Scholars:
2.7W
Papers: 2.5W
Citations: 3.5W
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
N
nankai university
Scholars:
4.7W
Papers: 3.2W
Citations: 74
researcher View more organizations