arrow
Return

XCast: A python climate forecasting toolkit

delete2022-07-15
delete5
delete
OA
AI
K
Kyle Joseph Chen Hall *
N
Nachiketa Acharya
DOI:10.3389/fclim.2022.953262delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Climate forecasts, both experimental and operational, are often made by calibrating Global Climate Model (GCM) outputs with observed climate variables using statistical and machine learning models. Often, machine learning techniques are applied to gridded data independently at each gridpoint. However, the implementation of these gridpoint-wise operations is a significant barrier to entry to climate data science. Unfortunately, there is a significant disconnect between the Python data science ecosystem and the gridded earth data ecosystem. Traditional Python data science tools are not designed to be used with gridded datasets, like those commonly used in climate forecasting. Heavy data preprocessing is needed: gridded data must be aggregated, reshaped, or reduced in dimensionality in order to fit the strict formatting requirements of Python's data science tools. Efficiently implementing this gridpoint-wise workflow is a time-consuming logistical burden which presents a high barrier to entry to earth data science. A set of high-performance, easy-to-use Python climate forecasting tools is needed to bridge the gap between Python's data science ecosystem and its gridded earth data ecosystem. XCast, an Xarray-based climate forecasting Python library developed by the authors, bridges this gap. XCast wraps underlying two-dimensional data science methods, like those of Scikit-Learn, with data structures that allow them to be applied to each gridpoint independently. XCast uses high-performance computing libraries to efficiently parallelize the gridpoint-wise application of data science utilities and make Python's traditional data science toolkits compatible with multidimensional gridded data. XCast also implements a diverse set of climate forecasting tools including traditional statistical methods, state-of-the-art machine learning approaches, preprocessing functionality (regridding, rescaling, smoothing), and postprocessing modules (cross validation, forecast verification, visualization). These tools are useful for producing and analyzing both experimental and operational climate forecasts. In this study, we describe the development of XCast, and present in-depth technical details on how XCast brings highly parallelized gridpoint-wise versions of traditional Python data science tools into Python's gridded earth data ecosystem. We also demonstrate a case study where XCast was used to generate experimental real-time deterministic and probabilistic forecasts for South Asian Summer Monsoon Rainfall in 2022 using different machine learning-based multi-model ensembles.
Keywords:
geospatial data
machine learning
statistical learning
Python tools
climate forecasting
parallel computing
global climate models

Journal

F
Frontiers in Climate
IF:
4.1
Papers:
1.2K
Citations:
2.9K

Organization

C
Columbia University
Scholars:
7.1W
Papers: 6.4W
Citations: 263
University of Colorado System cover
University of Colorado System
Scholars:
6.3W
Papers: 5.5W
Citations: 1.8K
Cited Papers

Cited Papers

THE NORTH AMERICAN MULTIMODEL ENSEMBLE Phase-1 Seasonal-to-Interannual Prediction; Phase-2 toward Developing Intraseasonal Prediction
err2014-04-01
err820
PREAI
errKirtman, Ben P.; Min, Dughong; Infanti, Johnna M.; Kinter, James L., III; Paolino, Daniel A.; Zhang, Qin; van den Dool, Huug; Saha, Suranjana; Mendez, Malaquias Pena; Becker, Emily; Peng, Peitao; Tripp, Patrick; Huang, Jin; DeWitt, David G.; Tippett, Michael K.; Barnston, Anthony G.; Li, Shuhua; Rosati, Anthony; Schubert, Siegfried D.; Rienecker, Michele; Suarez, Max; Li, Zhao E.; Marshak, Jelena; Lim, Young-Kwon; Tribbia, Joseph; Pegion, Kathleen; Merryfield, William J.; Denis, Bertrand; Wood, Eric F.
errShare
errSave
SciPy 1.0: fundamental algorithms for scientific computing in Python
err2020-02-03
err2.1W
errOAAI
errVirtanen, Pauli; Gommers, Ralf; Oliphant, Travis E.; Haberland, Matt; Reddy, Tyler; Cournapeau, David; Burovski, Evgeni; Peterson, Pearu; Weckesser, Warren; Bright, Jonathan; van der Walt, Stefan J.; Brett, Matthew; Wilson, Joshua; Millman, K. Jarrod; Mayorov, Nikolay; Nelson, Andrew R. J.; Jones, Eric; Kern, Robert; Larson, Eric; Carey, C. J.; Polat, Ilhan; Feng, Yu; Moore, Eric W.; VanderPlas, Jake; Laxalde, Denis; Perktold, Josef; Cimrman, Robert; Henriksen, Ian; Quintero, E. A.; Harris, Charles R.; Archibald, Anne M.; Ribeiro, Antonio H.; Pedregosa, Fabian; van Mulbregt, Paul
errShare
errSave
The HIT/DLR dexterous hand: work in progress
err2024-10-23
err0
PREAI
errX.H. Gao; M.H. Jin; L. Jiang; Z.W. Xie; P. He; L. Yang; Y.W. Liu; R. Wei; H.G. Cai; H. Liu; J. Butterfass; M. Grebenstein; N. Seitz; G. Hirzinger
errShare
errSave
Physics-informed machine learning: case studies for weather and climate modelling
err2021-02-15
err329
errOAAI
errKashinath, K.; Mustafa, M.; Albert, A.; Wu, J-L.; Jiang, C.; Esmaeilzadeh, S.; Azizzadenesheli, K.; Wang, R.; Chattopadhyay, A.; Singh, A.; Manepalli, A.; Chirila, D.; Yu, R.; Walters, R.; White, B.; Xiao, H.; Tchelepi, H. A.; Marcus, P.; Anandkumar, A.; Hassanzadeh, P.; Prabhat
errShare
errSave
Incremental extreme learning machine with fully complex hidden nodes
err2008-01-01
err227
PREAI
errHuang, Guang-Bin; Li, Ming-Bin; Chen, Lei; Siew, Chee-Kheong
errShare
errSave
XMCD study of the Ruddlesden-Popper-phase La1.2Nd0.2Sr1.6Mn2O7
err2001-03-01
err0
errOAAI
errF. Weigand; E. Goering; J. Geissler; M. Justen; K. Dörr; K. Ruck; G. Schütz
errShare
errSave
researcher View more