arrow
返回

RSVQA: Visual Question Answering for Remote Sensing Data

delete2020-12-01
delete142
delete
OA
AI
S
Sylvain Lobry *
D
Diego Marcos
J
Jesse Murray
D
Devis Tuia
DOI:10.1109/TGRS.2020.2988782delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This article introduces the task of visual question answering for remote sensing data (RSVQA). Remote sensing images contain a wealth of information, which can be useful for a wide range of tasks, including land cover classification, object counting, or detection. However, most of the available methodologies are task-specific, thus inhibiting generic and easy access to the information contained in remote sensing data. As a consequence, accurate remote sensing product generation still requires expert knowledge. With RSVQA, we propose a system to extract information from remote sensing data that is accessible to every user: we use questions formulated in natural language and use them to interact with the images. With the system, images can be queried to obtain high-level information specific to the image content or relational dependencies between objects visible in the images. Using an automatic method introduced in this article, we built two data sets (using low- and high-resolution data) of image/question/answer triplets. The information required to build the questions and answers is queried from OpenStreetMap (OSM). The data sets can be used to train (when using supervised methods) and evaluate models to solve the RSVQA task. We report the results obtained by applying a model based on convolutional neural networks (CNNs) for the visual part and a recurrent neural network (RNN) for the natural language part of this task. The model is trained on the two data sets, yielding promising results in both cases.
Keyword:
Remote sensing
Task analysis
Visualization
Data models
Feature extraction
Knowledge discovery
Recurrent neural networks
Convolution neural networks (CNNs)
data set
deep learning
natural language
OpenStreetMap (OSM)
recurrent neural networks (RNNs)
very high resolution (HR)
visual question answering (VQA)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

W
Wageningen University & Research
学者数:
2.9W
论文数: 2.8W
被引数: 55
引用论文

引用论文

Deep Learning for Hyperspectral Image Classification: An Overview用于高光谱图像分类的深度学习: 综述
err2019-09-01
err1.3K
errOAAI
errLi, Shutao; Song, Weiwei; Fang, Leyuan; Chen, Yushi; Ghamisi, Pedram; Benediktsson, Jon Atli
err分享
err收藏
Deep Learning in Remote Sensing遥感中的深度学习
err2017-12-01
err2.2K
errOAAI
errZhu, Xiao Xiang; Tuia, Devis; Mou, Lichao; Xia, Gui-Song; Zhang, Liangpei; Xu, Feng; Fraundorfer, Friedrich
err分享
err收藏
err分享
err收藏
学者 查看更多内容