.png){kind=icon}
返回
High-Resolution Remote Sensing Image Captioning Based on Structured Attention
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2021.3070383.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Automatically generating language descriptions of remote sensing images has become an emerging research hot spot in the remote sensing field. Attention-based captioning, as a representative group of recent deep learning-based captioning methods, shares the advantage of generating the words while highlighting corresponding object locations in the image. Standard attention-based methods generate captions based on coarse-grained and unstructured attention units, which fails to exploit structured spatial relations of semantic contents in remote sensing images. Although the structure characteristic makes remote sensing images widely divergent to natural images and poses a greater challenge for the remote sensing image captioning task, the key of most remote sensing captioning methods is usually borrowed from the computer vision community without considering the domain knowledge behind. To overcome this problem, a fine-grained, structured attention-based method is proposed to utilize the structural characteristics of semantic contents in high-resolution remote sensing images. Our method learns better descriptions and can generate pixelwise segmentation masks of semantic contents. The segmentation can be jointly trained with the captioning in a unified framework without requiring any pixelwise annotations. Evaluations are conducted on three remote sensing image captioning benchmark data sets with detailed ablation studies and parameter analysis. Compared with the state-of-the-art methods, our method achieves higher captioning accuracy and can generate high-resolution and meaningful segmentation masks of semantic contents at the same time.
Keyword:
Remote sensing
Semantics
Image segmentation
Proposals
Decoding
Task analysis
Feature extraction
Image captioning
image segmentation
remote sensing image
structured attention
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
Determinants of quality of life in patients with fibromyalgia: A structural equation modeling approach纤维肌痛患者生活质量的决定因素: 结构方程建模方法.png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏分享收藏Random Access Memories: A New Paradigm for Target Detection in High Resolution Aerial Remote Sensing Images随机存取存储器: 高分辨率航空遥感图像中目标检测的新范式
PREAI
分享收藏DSSNet: A Simple Dilated Semantic Segmentation Network for Hyperspectral Imagery Classification
PREAI
分享收藏
查看更多内容