Hurricane WRF Users Page

Frequently Asked Questions

Q: How do I get help if my questions are not answered in the User's Guide?

A: First, refer to the documentation on this website. If that doesn't answer your question, then write to HWRF helpdesk.

Q: How do I get data for running HWRF?

A: Please refer to our data FAQ.

Q: Can I run HWRF without the GFS ensemble?

A: Yes. The GFS ensemble is used as input to GSI during data assimilation. When the GFS ensemble is available, GSI runs in ensemble-variational hybrid data assimilation mode and uses flow-dependent information to create the background error covariance matrix. Conversely, when the GFS ensemble is not available, GSI uses the previously generated static background error covariance.

Q: What modules and settings are required to build and run on yellowstone?

A: In addition to the instructions in the users guide regarding envars and settings,

  • Load modules:
    1) ncarenv/1.0
    2) ncarbinlibs/1.1
    3) intel/12.1.5
    4) ncarcompilers/1.0
    5) netcdf/4.3.0
    6) pnetcdf/1.6.0
    7) lapack/3.2.1
    8) mkl/10.3.11
  • Configure/compile:
    • In general, select the ifort/icc dmpar with mkl option for each package
    • For GSI: setenv LAPACK_PATH /glade/apps/opt/lapack/3.2.1/lib64
    • You may see warnings from some components like:
    • ifort: command line warning #10006: ignoring unknown option '-f90=ifort'
      This may be ignored (or you can edit the configure.X to remove the -f90=ifort)
  • Runtime:
    The D03 GSI wrapper needs more memory per node than available on yellowstone, so modify the OMP and PPN values to:
    gsi_d03_wrapper: change OMP_NUM_THREADS to 1
    ush/hwrf/gsi.py: remove the OMP_STACKSIZE setting
    line 774
    change line 774 from:
    .env(OMP_STACKSIZE='128M') < 'gsiparm.anl')
    to: < 'gsiparm.anl')
  • Use ptile=4 when running gsi_d03
    Use ptile=8 when running gsi_d02
    Use ptile=8 when running init_gfs

Q: What modules and settings are required to build and run on cheyenne?

A: In addition to the instructions in the users guide regarding envars and settings,

  • Load modules:
    1) ncarenv/1.1
    2) intel/16.0.3
    3) impi/5.1.3.210
    4) ncarcompilers/0.4.1
    5) netcdf/4.4.1.1
    6) pnetcdf/1.8.0
    7) lapack/3.2.1
    8) mkl/11.3.3
  • Configure/compile:
    • Note: you must use the IMPI library to compile and run, and may need to "module unload mpt" before loading impi
    • In general, select the ifort/icc dmpar with mkl option for each package. Do NOT select MPT options!
    • Modify the "configure.X" for hwrf-utilities, UPP, ncep_coupler, GSI and pomtc to REMOVE the "-C" option from CCPFLAGS and FPP

    • Note: this will be patched in the next release, for V3.8a, please update by hand.
      Note: You may also change the arch/configure.defaults to remove the -C and then run configure. This is useful if you will be re-running configure, so you don't have to edit the configure.X each time.
  • Runtime:
    • Add a stanza for cheyenne to ush/hwrf_pre_job.sh.inc --- download here
    • Create a parm/system.conf file for cheyenne --- download here
    • GSI needs more memory/computing: change GSI_D02 to use 80 procs (instead of 60) in wrappers/gsi_d02_wrapper
    • Include the known-problems issue to correct the dtcgsi/fix fragment in ush/hwrf/launcher.py
    • An example set of qsub scripts for the wrappers are at: /glade/p/ral/jnt/HWRF/HWRF_v3.8a/cheyenne.qsub

UCAR | Privacy Policy | Terms of Use