arrow
返回

Spark-based adaptive Mapreduce data processing method for remote sensing imagery

delete2020-11-10
delete5
PRE
AI
X
Xicheng Tan
L
Liping Di
Y
Yanfei Zhong *
Y
Yayu Yao
Z
Ziheng Sun
Y
Yahya Ali
DOI:10.1080/01431161.2020.1804087delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing Hadoop-based remote sensing data processing approaches are insufficient for efficiently meeting the requirements of applications, especially when large remote sensing datasets are involved. This paper proposes an adaptive Spark-based remote sensing data processing method on the cloud that achieves improved efficiency and stability. The method includes a remote sensing data storage scheme on the cloud that employs the Hadoop Distributed File System (HDFS) and adaptive MapReduce mechanisms for use with remote sensing data; specifically, a mapping strategy for use with image tiles, a reducing strategy for use with adjacent tiles, and a mechanism for merging the results are proposed. An image classification experiment is conducted using Land Remote-Sensing Satellite System (Landsat) Thematic Mapper (TM) data, and the proposed method displays improved performance, stability and scalability compared to the existing Hadoop-based method. Hence, the proposed method is more suitable for processing large volumes of remote sensing data.
Keyword:
HADOOP MAPREDUCE
SYSTEM
OPTIMIZATION
FRAMEWORK
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Remote Sensing 封面图
International Journal of Remote Sensing
IF:
2.6
论文数:
1.2W
被引数:
2.7W

机构

G
George Mason University
学者数:
7.7K
论文数: 7.9K
被引数: 1.0W
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

Dyslexia Matters
err
IF0
err2008-04-16
err0
PREAI
err
err分享
err收藏
Urinary Vitamin D Binding Protein and KIM-1 Are Potent New Biomarkers of Major Adverse Renal Events in Patients Undergoing Coronary Angiography
err2016-01-11
err0
errOAAI
errLyubov Chaykovska; Fabian Heunisch; Gina von Einem; Markus L. Alter; Carl-Friedrich Hocher; Oleg Tsuprykov; Thomas Dschietzig; Axel Kretschmer; Berthold Hocher
err分享
err收藏
A Map-Reduce-enabled SOLAP cube for large-scale remotely sensed data aggregation
err2014-09-01
err28
PREAI
errLi, Jiyuan; Meng, Lingkui; Wang, Frank Z.; Zhang, Wen; Cai, Yang
err分享
err收藏
err分享
err收藏
Mammoth: Gearing Hadoop Towards Memory-Intensive MapReduce Applications
err2015-08-01
err28
errOAAI
errShi, Xuanhua; Chen, Ming; He, Ligang; Xie, Xu; Lu, Lu; Jin, Hai; Chen, Yong; Wu, Song
err分享
err收藏
Big data visual analytics for exploratory earth system simulation analysis
err2013-12-01
err65
PREAI
errSteed, Chad A.; Ricciuto, Daniel M.; Shipman, Galen; Smith, Brian; Thornton, Peter E.; Wang, Dali; Shi, Xiaoying; Williams, Dean N.
err分享
err收藏
学者 查看更多内容