.png){kind=icon}
返回
Learning consensus-aware semantic knowledge for remote sensing image captioning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2023.109893.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Tremendous progresses have been made in remote sensing image captioning (RSIC) task in recent years, yet there still some unresolved problems: (1) facing the gap between the visual features and semantic concepts, (2) reasoning the higher-level relationships between semantic concepts. In this work, we focus on injecting high-level visual-semantic interaction into RSIC model. Firstly, the semantic concept extractor (SCE), end-to end trainable, precisely captures the semantic concepts contained in the RSIs. In particular, the visual-semantic co-attention (VSCA) is designed to grain coarse concept-related regions and region-related concepts for multi modal interaction. Furthermore, we incorporate the two types of attentive vectors with semantic-level relational features into a consensus exploitation (CE) block for learning cross-modal consensus-aware knowledge. The experiments on three benchmark data sets show the superiority of our approach compared with the reference methods.
Keyword:
Cross-modal understanding
Visual-semantic interaction
Remote sensing image captioning
Graph convolutional network
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
HFA-Net: High frequency attention siamese network for building change detection in VHR remote sensing images.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏
分享收藏Meta captioning: A meta learning based remote sensing image captioning framework元字幕: 一种基于元学习的遥感图像字幕框架
PREAI
分享收藏分享收藏
查看更多内容