.png){kind=icon}
返回
Remote Sensing Image-Text Retrieval With Implicit-Explicit Relation Reasoning
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2024.3466909.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Remote sensing image-text retrieval (RSITR) has become a research hotspot in recent years for its wide application. Existing methods in this context, based either on local or global feature matching, overlook the sensing variation-leaded visual deviation and geographically nearby image-text mismatching problems of remote sensing (RS) images. This work notes that this would limit the retrieval accuracy for RSITR. To handle this, we present IERR, an implicit-explicit relation reasoning framework that learns relations between local visual-textual tokens and enhances global image-text matching without requiring additional prior supervision. Specifically, masked image modeling (MIM) and masked language modeling (MLM) are used for symmetric mask reasoning consistency alignment. Meanwhile, masked features (i.e., implicit relation) and unmasked features (i.e., explicit relation) are fed into a multimodal interaction encoder to enhance the representations of the textual-visual features. Extensive experimental results on the RSICD and RSITMD datasets demonstrate the superiority of IERR compared with 17 baselines.
Keyword:
masked image modeling (MIM)
Implicit relation reasoning
Implicit relation reasoning
Implicit relation reasoning
Implicit relation reasoning
Implicit relation reasoning
masked language modeling (MLM)
masked language modeling (MLM)
masked language modeling (MLM)
masked image modeling (MIM)
masked language modeling (MLM)
remote sensing image-text retrieval (RSITR)
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
分享收藏Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networks跨城市事务: 使用高分辨率域适应网络进行跨城市语义分割的多模态遥感基准数据集
OAAI
OAAI分享收藏CLIP4Clip: An empirical study of CLIP for end to end video clip retrieval and captioningCLIP4Clip: 端到端视频剪辑检索和字幕剪辑的实证研究.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏Formation of nitrosyl complexes in the reaction between platinum (II) nitro complexes and concentrated hydrochloric acid在铂 (II) 硝基配合物与浓盐酸之间的反应中形成亚硝基配合物
PREAI
分享收藏
查看更多内容