arrow
返回

XCast: A python climate forecasting toolkit

delete2022-07-15
delete5
delete
OA
AI
K
Kyle Joseph Chen Hall *
N
Nachiketa Acharya
DOI:10.3389/fclim.2022.953262delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Climate forecasts, both experimental and operational, are often made by calibrating Global Climate Model (GCM) outputs with observed climate variables using statistical and machine learning models. Often, machine learning techniques are applied to gridded data independently at each gridpoint. However, the implementation of these gridpoint-wise operations is a significant barrier to entry to climate data science. Unfortunately, there is a significant disconnect between the Python data science ecosystem and the gridded earth data ecosystem. Traditional Python data science tools are not designed to be used with gridded datasets, like those commonly used in climate forecasting. Heavy data preprocessing is needed: gridded data must be aggregated, reshaped, or reduced in dimensionality in order to fit the strict formatting requirements of Python's data science tools. Efficiently implementing this gridpoint-wise workflow is a time-consuming logistical burden which presents a high barrier to entry to earth data science. A set of high-performance, easy-to-use Python climate forecasting tools is needed to bridge the gap between Python's data science ecosystem and its gridded earth data ecosystem. XCast, an Xarray-based climate forecasting Python library developed by the authors, bridges this gap. XCast wraps underlying two-dimensional data science methods, like those of Scikit-Learn, with data structures that allow them to be applied to each gridpoint independently. XCast uses high-performance computing libraries to efficiently parallelize the gridpoint-wise application of data science utilities and make Python's traditional data science toolkits compatible with multidimensional gridded data. XCast also implements a diverse set of climate forecasting tools including traditional statistical methods, state-of-the-art machine learning approaches, preprocessing functionality (regridding, rescaling, smoothing), and postprocessing modules (cross validation, forecast verification, visualization). These tools are useful for producing and analyzing both experimental and operational climate forecasts. In this study, we describe the development of XCast, and present in-depth technical details on how XCast brings highly parallelized gridpoint-wise versions of traditional Python data science tools into Python's gridded earth data ecosystem. We also demonstrate a case study where XCast was used to generate experimental real-time deterministic and probabilistic forecasts for South Asian Summer Monsoon Rainfall in 2022 using different machine learning-based multi-model ensembles.
Keyword:
geospatial data
machine learning
statistical learning
Python tools
climate forecasting
parallel computing
global climate models

期刊

F
Frontiers in Climate
IF:
4.1
论文数:
1.2K
被引数:
2.9K

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
University of Colorado System 封面图
University of Colorado System
学者数:
6.3W
论文数: 5.5W
被引数: 1.8K
引用论文

引用论文

THE NORTH AMERICAN MULTIMODEL ENSEMBLE Phase-1 Seasonal-to-Interannual Prediction; Phase-2 toward Developing Intraseasonal Prediction
err2014-04-01
err820
PREAI
errKirtman, Ben P.; Min, Dughong; Infanti, Johnna M.; Kinter, James L., III; Paolino, Daniel A.; Zhang, Qin; van den Dool, Huug; Saha, Suranjana; Mendez, Malaquias Pena; Becker, Emily; Peng, Peitao; Tripp, Patrick; Huang, Jin; DeWitt, David G.; Tippett, Michael K.; Barnston, Anthony G.; Li, Shuhua; Rosati, Anthony; Schubert, Siegfried D.; Rienecker, Michele; Suarez, Max; Li, Zhao E.; Marshak, Jelena; Lim, Young-Kwon; Tribbia, Joseph; Pegion, Kathleen; Merryfield, William J.; Denis, Bertrand; Wood, Eric F.
err分享
err收藏
err分享
err收藏
SciPy 1.0: fundamental algorithms for scientific computing in PythonSciPy 1.0: Python中科学计算的基本算法
err2020-02-03
err2.1W
errOAAI
errVirtanen, Pauli; Gommers, Ralf; Oliphant, Travis E.; Haberland, Matt; Reddy, Tyler; Cournapeau, David; Burovski, Evgeni; Peterson, Pearu; Weckesser, Warren; Bright, Jonathan; van der Walt, Stefan J.; Brett, Matthew; Wilson, Joshua; Millman, K. Jarrod; Mayorov, Nikolay; Nelson, Andrew R. J.; Jones, Eric; Kern, Robert; Larson, Eric; Carey, C. J.; Polat, Ilhan; Feng, Yu; Moore, Eric W.; VanderPlas, Jake; Laxalde, Denis; Perktold, Josef; Cimrman, Robert; Henriksen, Ian; Quintero, E. A.; Harris, Charles R.; Archibald, Anne M.; Ribeiro, Antonio H.; Pedregosa, Fabian; van Mulbregt, Paul
err分享
err收藏
The HIT/DLR dexterous hand: work in progress
err2024-10-23
err0
PREAI
errX.H. Gao; M.H. Jin; L. Jiang; Z.W. Xie; P. He; L. Yang; Y.W. Liu; R. Wei; H.G. Cai; H. Liu; J. Butterfass; M. Grebenstein; N. Seitz; G. Hirzinger
err分享
err收藏
Physics-informed machine learning: case studies for weather and climate modelling以物理为基础的机器学习: 天气和气候建模的案例研究
err2021-02-15
err329
errOAAI
errKashinath, K.; Mustafa, M.; Albert, A.; Wu, J-L.; Jiang, C.; Esmaeilzadeh, S.; Azizzadenesheli, K.; Wang, R.; Chattopadhyay, A.; Singh, A.; Manepalli, A.; Chirila, D.; Yu, R.; Walters, R.; White, B.; Xiao, H.; Tchelepi, H. A.; Marcus, P.; Anandkumar, A.; Hassanzadeh, P.; Prabhat
err分享
err收藏
Incremental extreme learning machine with fully complex hidden nodes
err2008-01-01
err227
PREAI
errHuang, Guang-Bin; Li, Ming-Bin; Chen, Lei; Siew, Chee-Kheong
err分享
err收藏
XMCD study of the Ruddlesden-Popper-phase La1.2Nd0.2Sr1.6Mn2O7
err2001-03-01
err0
errOAAI
errF. Weigand; E. Goering; J. Geissler; M. Justen; K. Dörr; K. Ruck; G. Schütz
err分享
err收藏
学者 查看更多内容