2021 DTC UFS Evaluation Metrics Workshop | METplus Metrics Gaps

2021 DTC UFS Evaluation Metrics Workshop


METplus coverage

Statistics: Approximately 99% of the statistics associated with the prioritized fields across all applications are currently available in METplus.

Diagnostics: Approximately 70% of the diagnostics associate with prioritized processes are currently available in METplus

Reference Sources:  Approximately 62% of the reference sources (observations, analysis, climatologies) have been demonstrated within METplus.  

The METplus team is working to compile an cohesive inventory of statistics and diagnostics at this time.  For now, we refer you to the METplus (look at Use-Cases) and MET Users' Guides (Appendix C) for reference.


Gaps in METplus (based on final metrics)

Application/Component Statistics Diagnostics Reference Source
SRW - -

Ceilometer, ACARS, SPC Mesoanalysis, 3DRTMA, VAD winds,

Also see Land

MRW - - See Marine/Cryo, Hydro, and Land
S2S See Seasonal

Fire Danger Index

Also see Seasonal

ALEXI satellite data, CPC OLR Analysis,

Also See Marine/Cryo, Hydro, and Land

Seasonal Integrated Ice Edge AO/AAO Index, NAO/PNA Index, Palmer Drought Severity Index, East Asian Summer Monsoon Index

CPC Precip Analysis, OSI-SAF 10km Analysis

Also see Marine/Cryo, Hydro, and Land

Coastal - - Buoys, Ship Obs, C-MAN
DA (note - no final list so based on preliminary list)

Bias including covarience matrix,
Consistency Ratio

Forecast and Analysis Activity Diagnostics, Dropout Diagnostics -
Hydro (note - no final list so based on preliminary list) - Nash-Sutcliffe Efficiency Need to test: SNOTEL, MODIS/MODSCAG, SNODAS, UA, state mesonet, NOHRSC, IMS, NASA Snow analysis, NESDIS STAR snow cover product, USGS, USACE, USBR data
Hurricane -   See Marine/Cryo
Lake See as Marine/Cryo - See Marine/Cryo
Land (note - no final list so based on preliminary list) - - Need to test: International Soil Moisture Network, State Mesonets, AmeriFlux, Landsat,
Marine/Cryo Integrated Ice Edge, Modified Hausdorff, Error Radius - Need to test: Buoys, GODAE, Satellite Altimetry, OSCAR analysis, AMSR2, NSIDC analyses, ARGO, NASA Icebridge, Nesdis Ocean Heat Content Suite, NSIDC Near Real Time analysis, HF Radar, GIOMAS, XBT, ISAT2/C RYOSTAT2, YOPP obs, International Arctic Buoy Program obs
Space - - Need to test: Most sources except for TEC