arrow
返回

MAFH: Multilabel aware framework for bit-scalable cross-modal hashing

delete2023-11-01
delete6
PRE
AI
J
Jiong Yu *
H
Hongchun Lu
Z
Ziyang Li
DOI:10.1016/j.knosys.2023.110922delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep hashing techniques have received considerable attention and are widely used in the field of crossmodal retrieval. The training mode of deep cross-modal hashing models has also gradually converged. However, the commonly used training mode ignores noisy labels from different modality original datasets and can only generate fixed-length hash codes, resulting in poor robustness and flexibility of the training generated hash models. Therefore, to effectively optimize the training mode, we propose a multilabel aware framework for bit-scalable deep cross-modal hashing (MAFH) with the following contributions. First, we introduce a label network module to indirectly used the hash representation of multilabels to more accurately supervise the model training process across all modalities. Second, we design a scalable coding strategy to freely manipulate the length of the hash code, which makes the trained model flexible to adapt to different scenarios. Third, we propose a layered multilabel similarity algorithm to preserve more complete feature information, which avoids the loss of discriminative feature information during model training. The training mode of MAFH can effectively enhance model robustness, flexibility and accuracy. We selected thirteen representative hash methods to compare with the proposed method, and experimental results on four public datasets show that the proposed method achieves good performance. https://github.com/x-28/MAFH.git.(c) 2023 Published by Elsevier B.V.
Keyword:
Deep cross-modal hashing
Cross-modal retrieval
Multilabel similarity
Bit-scalable coding strategy

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.2W
被引数:
4.5W

机构

S
Southwest Jiaotong University
学者数:
2.9W
论文数: 2.1W
被引数: 2.3W
X
Xinjiang University
学者数:
1.4W
论文数: 8.7K
被引数: 1.1W
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Epidemiological investigation of equid herpesvirus-4 (EHV-4) excretion assessed by nasal swabs taken from thoroughbred foals
err1994-04-01
err0
PREAI
errJames Gilkerson; Louisa R. Jorm; Daria N. Love; Glenda L. Lawrence; J. Millar Whalley
err分享
err收藏
Evaluation of Antioxidant and Free Radical Scavenging Capacities of Polyphenolics from Pods of Caesalpinia pulcherrima
err2012-05-18
err0
errOAAI
errFeng-Lin Hsu; Wei-Jan Huang; Tzu-Hua Wu; Mei-Hsien Lee; Lih-Chi Chen; Hsiao-Jen Lu; Wen-Chi Hou; Mei-Hsiang Lin
err分享
err收藏
Whipple Limbic Encephalitis
err2011-11-01
err0
errOAAI
errFrédéric Blanc
err分享
err收藏
Irradiation-induced amorphization in the zirconium suboxide on Zr-0.5Nb alloys
err2019-01-01
err0
errOAAI
errJ. Liu; G. He; J. Hu; Z. Shen; M. Kirk; M. Li; E. Ryan; P. Baldo; S. Lozano-Perez; C. Grovenor
err分享
err收藏
High intensity interval training negatively affects mood state in professional athletes
err2018-09-01
err0
PREAI
errO. Selmi; W. Ben khalifa; M. Zouaoui; F. Azaiez; A. Bouassida
err分享
err收藏
学者 查看更多内容