Collaborative Learning for Extremely Low Bit Asymmetric Hashing

doi:10.1109/TKDE.2020.2977633

Collaborative Learning for Extremely Low Bit Asymmetric Hashing

2021-12-01

8

OA

AI

DOI：10.1109/TKDE.2020.2977633

Original

Save

View PDF

Abstract

En 中文

Hashing techniques are in great demand for a wide range of real-world applications such as image retrieval and network compression. Nevertheless, existing approaches could hardly guarantee a satisfactory performance with the extremely low-bit (e.g., 4-bit) hash codes due to the severe information loss and the shrink of the discrete solution space. In this article, we propose a novel Collaborative Learning strategy that is tailored for generating high-quality low-bit hash codes. The core idea is to jointly distill bit-specific and informative representations for a group of pre-defined code lengths. The learning of short hash codes among the group can benefit from the manifold shared with other long codes, where multiple views from different hash codes provide the supplementary guidance and regularization, making the convergence faster and more stable. To achieve that, an asymmetric hashing framework with two variants of multi-head embedding structures is derived, termed as Multi-head Asymmetric Hashing (MAH), leading to great efficiency of training and querying. Extensive experiments on three benchmark datasets have been conducted to verify the superiority of the proposed MAH, and have shown that the 8-bit hash codes generated by MAH achieve 94.3 percent of the MAP(1) 1. Mean Average Precision (MAP) score on the CIFAR-10 dataset, which significantly surpasses the performance of the 48-bit codes by the state-of-the-arts in image retrieval tasks.

Keywords:

Databases

Training

Collaborative work

Convergence

Task analysis

Semantics

Feature extraction

Deep hashing

asymmetric learning

knowledge distillation

Collaborative Learning for Extremely Low Bit Asymmetric Hashing

Abstract

AI Summary

Journal

Organization