arrow
Return

Process-Oriented Diagnostics Principles, Practice, Community Development, and Common Standards

delete2023-08-01
delete6
delete
OA
AI
J
J. David Neelin *
J
John P. Krasting
A
Aparna Radhakrishnan
J
Jessica Liptak
T
T. J. Jackson
Y
Yi Ming
W
Wenhao Dong
A
Andrew Gettelman
D
D. Coleman
E
Eric D. Maloney
A
Allison A. Wing
Y
Yi‐Hung Kuo
F
Fiaz Ahmed
P
Paul Ullrich
C
Cecilia M. Bitz
R
Richard Neale
A
Ana Ordonez
E
Elizabeth Maroon
DOI:10.1175/BAMS-D-21-0268.1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Process-oriented diagnostics (PODs) aim to provide feedback for model developers through model analysis based on physical hypotheses. However, the step from a diagnostic based on relationships among variables, even when hypothesis driven, to specific guidance for revising model formulation or parameterizations can be substantial. The POD may provide more informa-tion than a purely performance-based metric, but a gap between POD principles and providing actionable information for specific model revisions can remain. Furthermore, in coordinating diagnostics development, there is a trade-off between freedom for the developer, aiming to capture innovation, and near-term utility to the modeling center. Best practices that allow for the former, while conforming to specifications that aid the latter, are important for community diagnostics development that leads to tangible model improvements. Promising directions to close the gap between principles and practice include the interaction of PODs with perturbed physics experiments and with more quantitative process models as well as the inclusion of personnel from modeling centers in diagnostics development groups for immediate feedback during climate model revisions. Examples are provided, along with best-practice recommendations, based on practical experience from the NOAA Model Diagnostics Task Force (MDTF). Common standards for metrics and diagnostics that have arisen from a collaboration between the MDTF and the Department of Energy's Coordinated Model Evaluation Capability are advocated as a means of uniting community diagnostics efforts.
Keywords:
Atmosphere-ocean interaction
Clouds
Hurricanes/ typhoons
Hydrologic cycle
Model evaluation/ performance
Interannual variability

Journal

Bulletin of the American Meteorological Society cover
Bulletin of the American Meteorological Society
IF:
5.9
Papers:
3.7K
Citations:
2.7W

Organization

P
Pacific Northwest National Laboratory
Scholars:
9.0K
Papers: 6.3K
Citations: 14
N
national center atmospheric research (ncar) - usa
Scholars:
4.7K
Papers: 5.1K
Citations: 8
State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130
N
national oceanic atmospheric admin (noaa) - usa
Scholars:
1.4W
Papers: 1.1W
Citations: 10
P
Princeton University
Scholars:
2.1W
Papers: 2.3W
Citations: 5.1W
F
Florida State University
Scholars:
1.1W
Papers: 8.6K
Citations: 2.0W
U
university of california los angeles
Scholars:
5.3W
Papers: 4.2W
Citations: 89
C
Colorado State University
Scholars:
8.1K
Papers: 5.7K
Citations: 2.6W
U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
B
Boston College
Scholars:
5.4K
Papers: 5.2K
Citations: 8.8K
researcher View more organizations