Towards data analysis for weather cloud computing

doi:10.1016/j.knosys.2017.03.003

2017-07-01

Victor Chang *

DOI：10.1016/j.knosys.2017.03.003

原文链接

查看原文

摘要

En 中文

This paper demonstrates an innovative data analysis for weather using Cloud Computing, integrating both system and application Data Science services to investigate extreme weather events. Identifying five existing projects with ongoing challenges, our aim is to process, analyze and visualize collected data, study implications and report meaningful findings. We demonstrate the use of Cloud Computing technologies, MapReduce and optimization techniques to simulate temperature distributions and analyze weather data. Two major cases are presented. The first case is focused on forecasting temperatures based on studying trends from the historical data of Sydney, Singapore and London to compare the historical and forecasted temperatures. The second case is to use five-step MapReduce for numerical data analysis and eight-step process for visualization, which is used to analyze and visualize temperature distributions in the United States, before, during and after the time of experiencing polar vortex, as well as in the United Kingdom during and after the flood. Optimization was used in experiments involved up to 100 nodes between Cloud and non-Cloud and compared performance with and without optimization. There was an improvement in performance between 20% and 30% under 60 nodes in Cloud. Results, discussion and comparison were presented. We justify our research contributions and explain thoroughly in the paper how the three goals can be met: (1) forecasting temperatures of three cities based on evaluating the trends from the historical data; (2) using five-step MapReduce to achieve shorter execution time on Cloud and (3) using eight-step MapReduce with optimization to achieve data visualization for temperature distributions on US and UK maps. (C) 2017 Elsevier B.V. All rights reserved.

Keyword:

System and application for weather computation

Temperature forecasting and distribution

Mapreduce

Weather data visualization

Polar vortex

Weather data science

AI总结

对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Knowledge-Based Systems

IF:

7.6

论文数:

1.2W

被引数:

4.5W

机构

暂无机构信息

引用论文

A model to compare cloud and non-cloud storage of Big Data 大数据云和非云存储的比较模型

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE

IF6.1

2016-04-01

OAAI

Chang, Victor; Wills, Gary

Riboflavinuria in the rd chicken. 5'-splice site mutation in the gene for riboflavin-binding protein.

Journal of Biological Chemistry

IF0

1993-11-01

OAAI

I MacLachlan; J Nimpf; H B White; W.J. Schneider

The State of the Art in End-User Software Engineering 最终用户软件工程的最新技术

ACM COMPUTING SURVEYS

IF28

2011-04-29

341

OAAI

Ko, Andrew J.; Abraham, Robin; Beckwith, Laura; Blackwell, Alan; Burnett, Margaret; Erwig, Martin; Scaffidi, Chris; Lawrance, Joseph; Lieberman, Henry; Myers, Brad; Rosson, Mary Beth; Rothermel, Gregg; Shaw, Mary; Wiedenbeck, Susan

Recording Odor-Evoked Response Potentials at the Human Olfactory Epithelium

Chemical Senses

IF0

2012-09-02

PREAI

H. Lapid; T. Hummel

Survey of cytotoxicities and antimutagenic and antitumor initiating activities of Cu(II)(3,5-diisopropylsalicylate)₂ and its analogs in a keratinocyte-mediated mutation assay and the murine skin multistage carcinogenesis model

Carcinogenesis

IF0

1988-01-01

PREAI

John J. Reiners; Alan B. Colby