Note
Go to the end to download the full example code.
Gen-Ens-Prod: Basic Post-Processing only
model_application/precipitation/GenEnsProd_fcstHRRRE_FcstOnly_NetCDF.conf
Scientific Objective
Post-process ensemble members to derive simple (non-bias-corrected) mean, standard deviation (spread), minimum, maximum, and range fields for use in other MET tools.
Version Added
METplus version 3.0
Datasets
Forecast: NOAA High Resolution Rapid Refresh Ensemble (HRRRE) 3 member ensemble netcdf 3 hour precipitation accumulation
Observation: None
Climatology: None
Location: All of the input data required for this use case can be found in a sample data tarball. Each use case category will have one or more sample data tarballs. It is only necessary to download the tarball with the use case’s dataset and not the entire collection of sample data. Click here to access the METplus releases page and download sample data for the appropriate release: https://github.com/dtcenter/METplus/releases This tarball should be unpacked into the directory that you will set the value of INPUT_BASE. See Running METplus section for more information.
METplus Components
This use case runs gen_ens_prod on HRRRE data from 3 members after running it through pcp_combine to create a 3 hour precipitation accumulation
METplus Workflow
Beginning time (INIT_BEG): 2019051912
End time (INIT_END): 2019052000
Increment between beginning and end times (INIT_INCREMENT): 43200
Sequence of forecast leads to process (LEAD_SEQ): 3,6,9,12
The following tools are used for each run time: GenEnsProd
This example loops by initialization time. For each initialization time it will process forecast leads 3, 6, 9 and 12
Run times:
METplus Configuration
METplus first loads all of the configurations found in parm/metplus_config, then it loads any configuration files passed to METplus via the command line.
[config]
# Documentation for this use case can be found at
# https://metplus.readthedocs.io/en/latest/generated/model_applications/precipitation/GenEnsProd_fcstHRRRE_FcstOnly_NetCDF.html
# For additional information, please see the METplus Users Guide.
# https://metplus.readthedocs.io/en/latest/Users_Guide
###
# Processes to run
# https://metplus.readthedocs.io/en/latest/Users_Guide/systemconfiguration.html#process-list
###
PROCESS_LIST = GenEnsProd
###
# Time Info
# LOOP_BY options are INIT, VALID, RETRO, and REALTIME
# If set to INIT or RETRO:
# INIT_TIME_FMT, INIT_BEG, INIT_END, and INIT_INCREMENT must also be set
# If set to VALID or REALTIME:
# VALID_TIME_FMT, VALID_BEG, VALID_END, and VALID_INCREMENT must also be set
# LEAD_SEQ is the list of forecast leads to process
# https://metplus.readthedocs.io/en/latest/Users_Guide/systemconfiguration.html#timing-control
###
LOOP_BY = INIT
INIT_TIME_FMT = %Y%m%d%H
INIT_BEG=2019051912
INIT_END=2019052000
INIT_INCREMENT=43200
LEAD_SEQ = 3,6,9,12
###
# File I/O
# https://metplus.readthedocs.io/en/latest/Users_Guide/systemconfiguration.html#directory-and-filename-template-info
###
GEN_ENS_PROD_INPUT_DIR = {INPUT_BASE}/model_applications/precipitation/HRRRE/pcp_combine
GEN_ENS_PROD_INPUT_TEMPLATE = hrrrebegin_end_incr(1,3,1,2)_{init?fmt=%Y%m%d%H}f{lead?fmt=%HHH}_A03.nc
GEN_ENS_PROD_OUTPUT_DIR = {OUTPUT_BASE}/model_applications/precipitation/GenEnsProd_fcstHRRRE_FcstOnly_NetCDF/GenEnsProd
GEN_ENS_PROD_OUTPUT_TEMPLATE = {init?fmt=%Y%m%d%H%M}/gen_ens_prod_{ENS_VAR1_NAME}_{valid?fmt=%Y%m%d_%H%M%S}V_ens.nc
###
# Field Info
# https://metplus.readthedocs.io/en/latest/Users_Guide/systemconfiguration.html#field-info
###
ENS_VAR1_NAME = APCP_03
ENS_VAR1_LEVELS = "(*,*)"
###
# GenEnsProd Settings
# https://metplus.readthedocs.io/en/latest/Users_Guide/wrappers.html#genensprod
###
GEN_ENS_PROD_N_MEMBERS = 3
GEN_ENS_PROD_ENS_THRESH = 0.5
GEN_ENS_PROD_VLD_THRESH = 1.0
GEN_ENS_PROD_ENSEMBLE_FLAG_LATLON = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_MEAN = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_STDEV = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_MINUS = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_PLUS = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_MIN = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_MAX = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_RANGE = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_VLD_COUNT = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_FREQUENCY = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_NEP = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_NMEP = FALSE
MET Configuration
METplus sets environment variables based on user settings in the METplus configuration file. See How METplus controls MET config file settings for more details.
YOU SHOULD NOT SET ANY OF THESE ENVIRONMENT VARIABLES YOURSELF! THEY WILL BE OVERWRITTEN BY METPLUS WHEN IT CALLS THE MET TOOLS!
If there is a setting in the MET configuration file that is currently not supported by METplus you’d like to control, please refer to: Overriding Unsupported MET config file settings
GenEnsProdConfig_wrapped
////////////////////////////////////////////////////////////////////////////////
//
// Gen-Ens-Prod configuration file.
//
// For additional information, please see the MET Users Guide.
//
////////////////////////////////////////////////////////////////////////////////
//
// Output model name to be written
//
//model =
${METPLUS_MODEL}
//
// Output description to be written
// May be set separately in each "obs.field" entry
//
//desc =
${METPLUS_DESC}
////////////////////////////////////////////////////////////////////////////////
//
// Verification grid
// May be set separately in each "field" entry
//
//regrid = {
${METPLUS_REGRID_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// May be set separately in each "field" entry
//
//censor_thresh =
${METPLUS_CENSOR_THRESH}
//censor_val =
${METPLUS_CENSOR_VAL}
//normalize =
${METPLUS_NORMALIZE}
//cat_thresh =
${METPLUS_CAT_THRESH}
//nc_var_str =
${METPLUS_NC_VAR_STR}
//
// Ensemble fields to be processed
//
ens = {
//file_type =
${METPLUS_ENS_FILE_TYPE}
//ens_thresh =
${METPLUS_ENS_THRESH}
//vld_thresh =
${METPLUS_VLD_THRESH}
//field =
${METPLUS_ENS_FIELD}
${METPLUS_ENS_CLIMO_MEAN_DICT}
${METPLUS_ENS_CLIMO_STDEV_DICT}
}
//ens_member_ids =
${METPLUS_ENS_MEMBER_IDS}
//control_id =
${METPLUS_CONTROL_ID}
////////////////////////////////////////////////////////////////////////////////
//
// Neighborhood ensemble probabilities
//
//nbrhd_prob = {
${METPLUS_NBRHD_PROB_DICT}
//
// NMEP smoothing methods
//
//nmep_smooth = {
${METPLUS_NMEP_SMOOTH_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Climatology data
//
//climo_mean = {
${METPLUS_CLIMO_MEAN_DICT}
//climo_stdev = {
${METPLUS_CLIMO_STDEV_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Ensemble product output types
// May be set separately in each "ens.field" entry
//
//ensemble_flag = {
${METPLUS_ENSEMBLE_FLAG_DICT}
////////////////////////////////////////////////////////////////////////////////
//version = "V10.1.0";
////////////////////////////////////////////////////////////////////////////////
tmp_dir = "${MET_TMP_DIR}";
${METPLUS_MET_CONFIG_OVERRIDES}
Python Embedding
This use case does not use Python embedding.
User Scripting
User Scripting is not used in this use case.
Running METplus
The command to run this use case is:: Pass the use case configuration file to the run_metplus.py script along with any user-specific system configuration files if desired:
run_metplus.py /path/to/METplus/parm/use_cases/model_applications/precipitation/GenEnsProd_fcstHRRRE_FcstOnly_NetCDF.conf /path/to/user_system.conf
See Running METplus for more information.
Expected Output
A successful run will output the following both to the screen and to the logfile:
INFO: METplus has successfully finished running.
Refer to the value set for OUTPUT_BASE to find where the output data was generated. Output for this use case will be found in model_applications/precipitation/GenEnsProd_fcstHRRRE_FcstOnly_NetCDF/GenEnsProd (relative to OUTPUT_BASE) The following folder/file combination will be created:
-201905191200
gen_ens_prod_APCP_03_20190519_150000V_ens.nc
gen_ens_prod_APCP_03_20190519_180000V_ens.nc
gen_ens_prod_APCP_03_20190519_210000V_ens.nc
gen_ens_prod_APCP_03_20190520_000000V_ens.nc
-201905200000
gen_ens_prod_APCP_03_20190520_030000V_ens.nc
gen_ens_prod_APCP_03_20190520_060000V_ens.nc
gen_ens_prod_APCP_03_20190520_090000V_ens.nc
gen_ens_prod_APCP_03_20190520_120000V_ens.nc
Keywords
Note
GenEnsProdToolUseCase
NOAAHWTOrgUseCase
PrecipitationAppUseCase
NetCDFFileUseCase
EnsembleAppUseCase
ConvectionAllowingModelsAppUseCase
ProbabilityGenerationAppUseCase
ListExpansionFeatureUseCase
Navigate to the METplus Quick Search for Use Cases page to discover other similar use cases.
#