返回
Spark-based adaptive Mapreduce data processing method for remote sensing imagery
DOI:10.1080/01431161.2020.1804087.png)
摘要
En 中文
Existing Hadoop-based remote sensing data processing approaches are insufficient for efficiently meeting the requirements of applications, especially when large remote sensing datasets are involved. This paper proposes an adaptive Spark-based remote sensing data processing method on the cloud that achieves improved efficiency and stability. The method includes a remote sensing data storage scheme on the cloud that employs the Hadoop Distributed File System (HDFS) and adaptive MapReduce mechanisms for use with remote sensing data; specifically, a mapping strategy for use with image tiles, a reducing strategy for use with adjacent tiles, and a mechanism for merging the results are proposed. An image classification experiment is conducted using Land Remote-Sensing Satellite System (Landsat) Thematic Mapper (TM) data, and the proposed method displays improved performance, stability and scalability compared to the existing Hadoop-based method. Hence, the proposed method is more suitable for processing large volumes of remote sensing data.
Keyword:
HADOOP MAPREDUCE
SYSTEM
OPTIMIZATION
FRAMEWORK
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.6
论文数:
1.2W
被引数:
2.7W
机构
引用论文
Urinary Vitamin D Binding Protein and KIM-1 Are Potent New Biomarkers of Major Adverse Renal Events in Patients Undergoing Coronary Angiography
PLOS ONE
IF0

