arrow
返回

Performance metrics for climate models

delete2008-03-20
delete1.0K
PRE
AI
P
Peter J. Gleckler *
K
Karl E. Taylor
C
Charles Doutriaux
DOI:10.1029/2007JD008972delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Objective measures of climate model performance are proposed and used to assess simulations of the 20th century, which are available from the Coupled Model Intercomparison Project (CMIP3) archive. The primary focus of this analysis is on the climatology of atmospheric fields. For each variable considered, the models are ranked according to a measure of relative error. Based on an average of the relative errors over all fields considered, some models appear to perform substantially better than others. Forming a single index of model performance, however, can be misleading in that it hides a more complex picture of the relative merits of different models. This is demonstrated by examining individual variables and showing that the relative ranking of models varies considerably from one variable to the next. A remarkable exception to this finding is that the so-called mean model'' consistently outperforms all other models in nearly every respect. The usefulness, limitations and robustness of the metrics defined here are evaluated 1) by examining whether the information provided by each metric is correlated in any way with the others, and 2) by determining how sensitive the metrics are to such factors as observational uncertainty, spatial scale, and the domain considered (e. g., tropics versus extra-tropics). An index that gauges the fidelity of model variability on interannual time-scales is found to be only weakly correlated with an index of the mean climate performance. This illustrates the importance of evaluating a broad spectrum of climate processes and phenomena since accurate simulation of one aspect of climate does not guarantee accurate representation of other aspects. Once a broad suite of metrics has been developed to characterize model performance it may become possible to identify optimal subsets for various applications.
Keyword:
GPCP
UNCERTAINTIES
PRODUCTS
CLOUDS

期刊

J
Journal of Geophysical Research and Atmospheres
IF:
3.4
论文数:
2.2W
被引数:
7.7W

机构

U
united states department of energy (doe)
学者数:
11.3W
论文数: 9.6W
被引数: 246
引用论文

引用论文

Improved analyses of changes and uncertainties in sea surface temperature measured in situ since the mid-nineteenth century: The HadSST2 dataset
err2006-02-01
err727
errOAAI
errRayner, NA; Brohan, P; Parker, DE; Folland, CK; Kennedy, JJ; Vanicek, M; Ansell, TJ; Tett, SFB
err分享
err收藏
The Global Precipitation Climatology Project (GPCP) Combined Precipitation Dataset
err1997-01-01
err1.5K
errOAAI
errHuffman, GJ; Adler, RF; Arkin, P; Chang, A; Ferraro, R; Gruber, A; Janowiak, J; McNab, A; Rudolf, B; Schneider, U
err分享
err收藏
The NCEP/NCAR 40-year reanalysis projectNCEP/NCAR 40年再分析项目
err1996-03-01
err2.8W
errOAAI
errKalnay, E; Kanamitsu, M; Kistler, R; Collins, W; Deaven, D; Gandin, L; Iredell, M; Saha, S; White, G; Woollen, J; Zhu, Y; Chelliah, M; Ebisuzaki, W; Higgins, W; Janowiak, J; Mo, KC; Ropelewski, C; Wang, J; Leetmaa, A; Reynolds, R; Jenne, R; Joseph, D
err分享
err收藏
The version-2 global precipitation climatology project (GPCP) monthly precipitation analysis (1979-present)version-2全球降水气候学项目 (GPCP) 月降水分析 (1979至今)
err2003-12-01
err5.0K
errOAAI
errAdler, RF; Huffman, GJ; Chang, A; Ferraro, R; Xie, PP; Janowiak, J; Rudolf, B; Schneider, U; Curtis, S; Bolvin, D; Gruber, A; Susskind, J; Arkin, P; Nelkin, E
err分享
err收藏
The NVAP global water vapor data set: independent cross-comparison and multiyear variability
err2001-04-01
err34
PREAI
errSimpson, JJ; Berg, JS; Koblinsky, CJ; Hufford, GL; Beckley, B
err分享
err收藏
err分享
err收藏
学者 查看更多内容