NWP Containers Online Tutorial | Publicly Available Data Sets

Publicly Available Data Sets

There are a number of publicly available data sets that can be used for initial and boundary conditions, data assimilation, and verification:

A list of the NOAA Big Data Program Datasets can be found here: https://www.noaa.gov/organization/information-technology/list-of-big-data-program-datasets

Model forecast data sets:

• NOMADS: https://nomads.ncep.noaa.gov/pub/data/nccf/com/{model}/prod, where model may be:

  • GFS (grib2 or nemsio) - available for the last 10 days https://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/

  • NAM - available for the last 8 days https://nomads.ncep.noaa.gov/pub/data/nccf/com/nam/prod/

  • RAP - available for the last 2 days https://nomads.ncep.noaa.gov/pub/data/nccf/com/rap/prod/

  • HRRR - available for the last 2 days https://nomads.ncep.noaa.gov/pub/data/nccf/com/hrrr/prod/

• NCEI archive

  • GFS: https://www.ncei.noaa.gov/products/weather-climate-models/global-forecast

  • NAM: https://www.ncei.noaa.gov/products/weather-climate-models/north-american-mesoscale

  • RAP: https://www.ncei.noaa.gov/products/weather-climate-models/rapid-refresh-update

• AWS S3:

  • GFS: https://registry.opendata.aws/noaa-gfs-bdp-pds/

  • HRRR: https://registry.opendata.aws/noaa-hrrr-pds/ (necessary fields for initializing available for dates 2015 and newer)

  • RAP: https://registry.opendata.aws/noaa-rap/

  • NAM: https://registry.opendata.aws/noaa-nam/

• Google Cloud:

  • HRRR: https://console.cloud.google.com/marketplace/product/noaa-public/hrrr

• Others:

  • Univ. of Utah HRRR archive: http://home.chpc.utah.edu/~u0553130/Brian_Blaylock/cgi-bin/hrrr_download.cgi

  • NAM nest archive: https://www.ready.noaa.gov/archives.php

  • NAM data older than 6 months can be requested through the Archive Information Request System: https://www.ncei.noaa.gov/has/HAS.FileAppRouter?datasetname=NAM218&subqueryby=STATION&applname=&outdest=FILE

  • RAP isobaric data older than 6 months can be requested through the Archive Information Request System: https://www.ncei.noaa.gov/has/HAS.FileAppRouter?datasetname=RAP130&subqueryby=STATION&applname=&outdest=FILE

Gridded precipitation data sets:

• NCEP National StageIV Precipitation Analysis data

  • NCEP NOMADS Site: https://nomads.ncep.noaa.gov/pub/data/nccf/com/pcpanl/prod/

    • Past 14 days

  • NCEP FTP Site: ftp://ftp.emc.ncep.noaa.gov/mmb/sref/st2n4.arch

  • NCAR EOL Site: https://data.eol.ucar.edu/dataset/21.093

• Multi-Radar/Multi-Sensor (MRMS) System Analysis data: https://mrms.ncep.noaa.gov/data/

  • Two day archive of precipitation, radar, and aviation and severe weather fields

• Climatology-Calibrated Precipitation Analysis: https://ftp.ncep.noaa.gov/data/nccf/com/ccpa/prod/

  • 8 days of most recent data

Prepbufr point observations:

• AWS S3:

  • GFS: https://registry.opendata.aws/noaa-gfs-bdp-pds/

  • RAP: https://registry.opendata.aws/noaa-rap/

  • NAM: https://registry.opendata.aws/noaa-nam/

• NCEP NOMADS Site:

  • PrepBufr for GDAS (Global): http://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod

    • 10 days of most recent data

    • Data: gdas.YYYYMMDD/HH/gdas.tHHz.prepbufr.nr

  • PrepBufr for RAP (CONUS): http://nomads.ncep.noaa.gov/pub/data/nccf/com/rap/prod

    • 1-2 days of most recent data

    • Data: rap.YYYYMMDD/rap.tHHz.prepbufr.tm00.nr

• NCEP FTP Site:

  • PrepBufr for GDAS (Global): ftp://ftpprd.ncep.noaa.gov/pub/data/nccf/com/gfs/prod

    • 10 days of most recent data

  • PrepBufr for NDAS (North America): ftp://ftpprd.ncep.noaa.gov/pub/data/nccf/com/rap/prod

    • 1-2 days of most recent data

• NCAR CISL Site:

  • DS337.0: NCEP PrepBufr ADP Global Upper Air and Surface Observations - archive starting May 1997

  • DS337.0 Subset: Interactive tool for running PB2NC over a specified time period and geographic region