arrow
Return

Learning Transformation-Invariant Local Descriptors With Low-Coupling Binary Codes

delete2021-01-01
delete24
delete
OA
AI
Y
Yunqi Miao
Z
Zijia Lin
X
Xiao Ma
丁贵广 cover
丁贵广 (Guiguang Ding)
韩军功 (Jungong Han) *
DOI:10.1109/TIP.2021.3106805delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Despite the great success achieved by prevailing binary local descriptors, they are still suffering from two problems: 1) vulnerable to the geometric transformations; 2) lack of an effective treatment to the highly-correlated bits that are generated by directly applying the scheme of image hashing. To tackle both limitations, we propose an unsupervised Transformation-invariant Binary Local Descriptor learning method (TBLD). Specifically, the transformation invariance of binary local descriptors is ensured by projecting the original patches and their transformed counterparts into an identical high-dimensional feature space and an identical low-dimensional descriptor space simultaneously. Meanwhile, it enforces the dissimilar image patches to have distinctive binary local descriptors. Moreover, to reduce high correlations between bits, we propose a bottom-up learning strategy, termed Adversarial Constraint Module, where low-coupling binary codes are introduced externally to guide the learning of binary local descriptors. With the aid of the Wasserstein loss, the framework is optimized to encourage the distribution of the generated binary local descriptors to mimic that of the introduced low-coupling binary codes, eventually making the former more low-coupling. Experimental results on three benchmark datasets well demonstrate the superiority of the proposed method over the state-of-the-art methods. The project page is available at https://github.com/yoqim/TBLD.
Keywords:
Correlation
Binary codes
Training
Visualization
Feature extraction
Entropy
Deep learning
Binary local descriptor
patch matching
deep learning

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137
A
Aberystwyth University
Scholars:
2.5K
Papers: 2.5K
Citations: 4.3K
U
University of Warwick
Scholars:
2.2W
Papers: 2.2W
Citations: 85
researcher View more organizations