.png){kind=icon}
返回
Continuous cross-modal hashing
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2023.109662.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Generally, multimodal data with new classes arrive continuously in the real world. While advanced cross -modal hashing (CMH) focuses primarily on batch-based data with previously observed classes (ASCs), it disregards the effect of newly arriving classes (ANCs) on hash-code conflicts. In addition, class-level continuous hashing scenarios do not suit themselves well with the generic CMH configuration. To solve the aforementioned issues, we propose a novel framework, called CT-CMH, for the new task of continuous cross-modal hashing. For dealing with ANCs, CMH models require the ability of continuous learning, i.e. they can preserve the knowledge of previously observed data and, more crucially, they can be adapted to unseen data with ANCs. Specifically, we introduce the adaptive weight importance updating (AWIU) mechanism to alleviate the catastrophic forgetting problem of CMH and a new hash-code divergence (HCD) method to eliminate hash-code conflicts between ASCs and ANCs. When CT-CMH is equipped with both AWIU and HCD, it can consistently achieve high retrieval performance. The experiment results and visualization analyses validate the effectiveness of our approach. To the best of our knowledge, we are the first to introduce and implement the task of CCMH for ANCs.(c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Cross-modal hashing
Fast retrieval
Multiple modalities
Continual learning
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Unsupervised Deep Cross -modal Hashing with Virtual Label Regression基于虚拟标签回归的无监督深度跨模态哈希.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏分享收藏Label Consistent Flexible Matrix Factorization Hashing for Efficient Cross-modal Retrieval标签一致的灵活矩阵分解哈希用于高效的跨模态检索
PREAI
分享收藏
查看更多内容