.png){kind=icon}
返回
Cross-modal retrieval with dual optimization
.png){kind=icon}
PRE
AI
DOI：10.1007/s11042-022-13650-0.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
For the flexible retrieval of data in different modalities, cross-modal retrieval has gradually attracted the attention of researchers. However, there is a heterogeneity gap between the data of different modalities, which cannot be measured directly. To solve this problem, researchers project data of different modalities into a common representation space to compensate for the heterogeneity of data of different modalities. However, existing methods with pair or triple constraints ignore the rich information between samples, which leads to the degradation of retrieval performance. In order to fully mine the information of samples, this paper proposes a cross-modal retrieval method (CMRDO) with dual optimization. First, the method optimizes the common representation space from inter-modal and intra-modal, respectively. Secondly, we introduce an efficient sample construction strategy to avoid sample pairs with less information. Finally, the bi-directional retrieval strategy we introduced can effectively capture the potential structure of query modal. In the three public datasets, the proposed CMRDO can effectively improve the final cross-modal retrieval accuracy, and has strong generalization ability.
Keyword:
Cross-modal retrieval
Modality gap
Inter-modal optimization
Intra-modal optimization
期刊
IF:
3
论文数:
2.0W
被引数:
3.2W
机构
引用论文
.png){kind=icon}
分享收藏Research on data mining of permissions mode for Android malware detection面向Android恶意软件检测的权限模式数据挖掘研究
PREAI
分享收藏
CCL: Cross-modal Correlation Learning With Multigrained Fusion by Hierarchical NetworkCCL: 分层网络多粒度融合的跨模态相关学习
OAAI
OAAI分享收藏SCH-GAN: Semi-Supervised Cross-Modal Hashing by Generative Adversarial NetworkSch-gan: 基于生成对抗网络的半监督跨模态哈希OAAI
OAAI分享收藏分享收藏
查看更多内容