arrow
Return

Semantic deep cross-modal hashing

delete2020-07-01
delete17
PRE
AI
Q
Qiubin Lin
W
Wenming Cao *
何志海 (Zhihai He)
Z
Zhiquan He
DOI:10.1016/j.neucom.2020.02.043delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Because an increasing number of modality data emerge on the Internet, cross-modal retrieval has become a nontrivial research topic. Furthermore, given the massive amount of cross-modal data and the high dimension of their features, hashing has been explored because it can reduce storage cost and accelerate retrieval speed. In this paper, we put forward a deep cross-modal hashing approach, dubbed semantic deep cross-modal hashing (SDCH). It can make effective use of semantic label information and generate more discriminative hash codes. Specifically, it utilizes the semantic label branches to improve the feature learning part, which can preserve semantic information of the learned features and keep the invariability of cross-modal data. Furthermore, it employs the hash codes learning branches to maintain the consistency of hash codes between different modalities in the Hamming space. Besides, it adopts inter-modal pairwise loss, cross-entropy loss and quantization loss to ensure that the ranking relevance of all similar instance pairs is higher than that of dissimilar ones. Compared to the most advanced method, attention-aware deep adversarial hashing (AADAH), SDCH averagely improves 6.14%, 4.84%, and 3.75% on three widely used datasets, IAPR TC-12, MIR-Flickr 25k, and NUS-WIDE, respectively. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Cross-modal retrieval
Hashing
Semantic label information
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

S
shenzhen university
Scholars:
4.5W
Papers: 3.4W
Citations: 72
University of Missouri System cover
University of Missouri System
Scholars:
2.9W
Papers: 2.7W
Citations: 75