arrow
返回

Multiscale Methods for Optical Remote-Sensing Image Captioning

delete2021-11-01
delete30
delete
OA
AI
X
Xiaofeng Ma
R
Rui Zhao
Z
Zhenwei Shi *
DOI:10.1109/LGRS.2020.3009243delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Recently, the optical remote-sensing image-captioning task has gradually become a research hotspot because of its application prospects in the military and civil fields. Many different methods along with data sets have been proposed. Among them, the models following the encoder-decoder framework have better performance in many aspects like generating more accurate and flexible sentences. However, almost all these methods are of a single fixed receptive field and could not put enough attention on grabbing the multiscale information, which leads to incomplete image representation. In this letter, we deal with the multiscale problem and propose two multiscale methods named multiscale attention (MSA) method and multifeat attention (MFA) method, to obtain better representations for the captioning task in the remote-sensing field. The MSA method extracts features from different layers and uses the multihead attention mechanism to obtain the context feature, respectively. The MFA method combines the target-level features and the scene-level features by using the target-detection task as the auxiliary task to enrich the context feature. The experimental results demonstrate that both of them perform better with regard to the metrics like BLEU, METEOR, ROUGE_L, and CIDEr than the benchmark method.
Keyword:
Feature extraction
Remote sensing
Task analysis
Optical imaging
Semantics
Training
Measurement
Remote-sensing image captioning
multiscale
auxiliary task
attention
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Geoscience and Remote Sensing Magazine 封面图
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
论文数:
1.0W
被引数:
5.1K

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
引用论文

引用论文

VAA: Visual Aligning Attention Model for Remote Sensing Image CaptioningVAA: 遥感图像字幕的视觉对准注意模型
err2019-01-01
err33
errOAAI
errZhang, Zhengyuan; Zhang, Wenkai; Diao, Wenhui; Yan, Menglong; Ga, Xin; Sun, Xian
err分享
err收藏
没有更多内容