arrow
返回

An Efficient and Scalable Framework for Processing Remotely Sensed Big Data in Cloud Computing Environments

delete2019-07-01
delete69
PRE
AI
J
Jin Sun
Y
Yi Zhang
Z
Zebin Wu *
Y
Yaoqin Zhu
X
Xianliang Yin
Z
Zhongzheng Ding
Z
Zhihui Wei
J
Javier Plaza
A
Antonio Plaza
DOI:10.1109/TGRS.2018.2890513delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The large amount of data produced by satellites and airborne remote sensing instruments has posed important challenges to efficient and scalable processing of remotely sensed data in the context of various applications. In this paper, we propose a new big data framework for processing massive amounts of remote sensing images on cloud computing platforms. In addition to taking advantage of the parallel processing abilities of cloud computing to cope with large-scale remote sensing data, this framework incorporates task scheduling strategy to further exploit the parallelism during the distributed processing stage. Using a computation- and data-intensive pan-sharpening method as a study case, the proposed approach starts by profiling a remote sensing application and characterizing it into a directed acyclic graph (DAG). With the obtained DAG representing the application, we further develop an optimization framework that incorporates the distributed computing mechanism and task scheduling strategy to minimize the total execution time. By determining an optimized solution of task partitioning and task assignments, high utilization of cloud computing resources and accordingly a significant speedup can be achieved for remote sensing data processing. Experimental results demonstrate that the proposed framework achieves promising results in terms of execution time as compared with the traditional (serial) processing approach. Our results also show that the proposed approach is scalable with regard to the increasing scale of remote sensing data.
Keyword:
Big data processing
cloud computing
remote sensing
task scheduling
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

暂无机构信息
引用论文

引用论文

The sinusoidal probe: a new approach to improve electrode longevity
err2014-04-29
err0
errOAAI
errHarbaljit S. Sohal; Andrew Jackson; Richard Jackson; Gavin J. Clowry; Konstantin Vassilevski; Anthony O’Neill; Stuart N. Baker
err分享
err收藏
Exploiting Different Types of Parallelism in Distributed Analysis of Remote Sensing Data
err2017-08-01
err7
PREAI
errCosta, Gilson A. O. P.; Bentes, Cristiana; Ferreira, Rodrigo S.; Feitosa, Raul Q.; Oliveira, Dario A. B.
err分享
err收藏
A New Pan-Sharpening Method With Deep Neural Networks
err2015-05-01
err293
PREAI
errHuang, Wei; Xiao, Liang; Wei, Zhihui; Liu, Hongyi; Tang, Songze
err分享
err收藏
Energy analysis using carbon and metallic oxides-based nanomaterials inside a solar collector
err2020-11-01
err0
errOAAI
errSuhong Liu; Haitham Abdulmohsin Afan; Mohammed Suleman Aldlemy; Nadhir Al-Ansari; Zaher Mundher Yaseen
err分享
err收藏
Storage and processing of massive remote sensing images using a novel cloud computing platform
err2013-07-02
err20
PREAI
errLin, Feng-Cheng; Chung, Lan-Kun; Wang, Chun-Ju; Ku, Wen-Yuan; Chou, Tien-Yin
err分享
err收藏
学者 查看更多内容