arrow
返回

Deep Unsupervised Binary Descriptor Learning Through Locality Consistency and Self Distinctiveness

delete2021-01-01
delete33
PRE
AI
樊
樊彬 (Bin Fan)
H
Hongmin Liu *
H
Hui Zeng
J
Jiyong Zhang
X
Xin Liu
J
Junwei Han
DOI:10.1109/TMM.2020.3016122delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning has been successfully applied to learn local feature descriptors in recent years. However, most of existing methods are supervised methods relying on a large number of labeled training patches, which are also proposed for learning real valued descriptors. In this paper, we propose a novel unsupervised deep learning method for binary descriptor learning. The binary descriptors are much more compact and efficient than the real valued descriptors and unsupervised leaning is highly required in many applications due to its label-free characteristic as the annotations are sometimes expensive to obtain. The core idea of our method is to explore the locality consistency in the descriptor space as well as to distinguish different patches while maintaining the ability to match a patch with its geometric transformed ones. We also give a theorical analysis about the role of batch normalization in learning effective binary descriptors. Benefited from this analysis, there is no need to append two additional losses on minimizing the quantization error and maximizing the entropy to the final learning objective like previous works did, thus simplifying our network training. Experiments on four benchmarks demonstrate that the proposed method is able to learn binary descriptors significantly outperforming previous unsupervised binary descriptors, even superior to most supervised ones. Especially, it obtains 21.2% of improvement on the UBC Phototour dataset, and 19.8%, 26.7%, 26.0% of improvements for patch verification, matching, retrieval tasks respectively on the HPatches dataset compared to the previous best unsupervised method.
Keyword:
Machine learning
Robustness
Quantization (signal)
Binary codes
Task analysis
Feature extraction
Training
Unsupervised learning
deep learning
pattern matching
feature extraction
compact descriptor
mobile applications
image retrieval
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.7K
被引数:
2.4W

机构

H
Hangzhou Dianzi University
学者数:
1.3W
论文数: 9.6K
被引数: 7.5K
N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

Pumilio1 phosphorylation precedes translational activation of its target mRNA in zebrafish oocytes
err2018-10-05
err0
errOAAI
errAtsushi Saitoh; Yuki Takada; Mayu Horie; Tomoya Kotani
err分享
err收藏
err分享
err收藏
Receptive Fields Selection for Binary Feature Description
err2014-06-01
err86
PREAI
errFan, Bin; Kong, Qingqun; Trzcinski, Tomasz; Wang, Zhiheng; Pan, Chunhong; Fua, Pascal
err分享
err收藏
1H-MR spectroscopy differentiates mild cognitive impairment from normal brain aging
err2001-08-01
err0
PREAI
errMarco Catani; Antonio Cherubini; Robert Howard; Roberto Tarducci; GianPiero Pelliccioli; Massimo Piccirilli; Gianni Gobbi; Umberto Senin; Patrizia Mecocci
err分享
err收藏
A Performance Evaluation of Local Features for Image-Based 3D Reconstruction
err2019-10-01
err78
errOAAI
errFan, Bin; Kong, Qingqun; Wang, Xinchao; Wang, Zhiheng; Xiang, Shiming; Pan, Chunhong; Fua, Pascal
err分享
err收藏
Interaction of cyclosporin A with human lipoproteins
err1986-08-01
err0
PREAI
errDemetrios Sgoutas; Wendy Macmahon; Ann Love; Ivanka Jerkunica
err分享
err收藏
学者 查看更多内容