Skip to content

Commit

Permalink
feature/global_det_mpmd (#610)
Browse files Browse the repository at this point in the history 
* Initial commit of changes for atmos stats grid2grid MPMD job output

* Updates for copying to COMOUT in MPMD jobs

* Update TMP_DIR

* Remove SENDCOM checks

* Add MPMD working directory changes for global_det atmos g2g stats assemble_data

* Switch order of files to check as input

* Fix variable name

* Add MPMD working directory changes for global_det atmos g2g stats generate_stats

* Add MPMD working directory changes for global_det atmos g2g stats gather_stats

* Move os import

* Standardized INPUT_BASE

* Add file check

* Rework MPMD directory writing for global_det atmos grid2grid stats

* Add MPMD directory work for atmos grid2obs stats reformat_data

* Add MPMD directory work for atmos grid2obs stats assemble_data

* Set TMP_DIR to MET_TMP_DIR

* Remove extra import glob

* Rename directory

* Fix file name

* Only print missing data for False found_input

* Fix file path

* Remove logging messages if restart

* Add MPMD directory work for atmos grid2obs stats generate_stats

* Add MPMD directory work for atmos grid2obs stats garther_stats

* Add err_chk

* Add \n

* Make enhancements for restart

* Remove making of MET_TMP_DIR for atmos stats

* Add MPMD directory work for atmos wmo stats reformat_data

* Update script purpose

* Fix restart

* Add MPMD directory work for atmos wmo stats assemble_data

* Add MPMD directory work for atmos wmo stats generate_stats

* Add MPMD directory work for atmos wmo stats gather_stats

* Add MPMD directory work for wave stats

* Add MPMD directory work for wave plots

* Add inital MPMD directory work for atmos grid2grid plots condense_stats

* Add additional MPMD directory work for atmos grid2grid plots condense_stats

* Add MPMD directory work for atmos grid2grid plots filter_stats

* Add inital MPMD directory work for atmos grid2grid plots make_plots

* Add MPMD directory work for atmos grid2grid plots tar_images

* Improve restart for condense_stats, filter_stats, and make_plots

* Improve restart for tar_images

* Remove wind shear script copy to DATA

* Add inital MPMD directory work for atmos grid2grid precip plots

* Final changes for atmos grid2grid precip plots

* Changes for changes for atmos grid2grid snow plots

* Changes for atmos grid2grid snow plots

* Remove global_det_atmos_plots_production_tof240.py

* Fix typo

* Changes for atmos grid2obs plots

* Changes for atmos wmo monthly

* Fixes for NOHRSC spatial map

* Add rstprod permissions for files in working dir
  • Loading branch information
@malloryprow
malloryprow authored Dec 4, 2024
1 parent 5060d4a commit 68a4fc0
Show file tree
Hide file tree
Showing 91 changed files with 2,741 additions and 2,647 deletions.
8 changes: 4 additions & 4 deletions parm/metplus_config/plots/global_det/wave_grid2obs/py_plotting_wave.config
View file
Original file line number Diff line number Diff line change
Expand Up @@ -91,16 +91,16 @@ export URL_HEADER=""

export USH_DIR=${USHevs}/${COMPONENT}
export FIX_DIR=${FIXevs}
export PRUNE_DIR=${DATA}
export SAVE_DIR=${DATA}
export PRUNE_DIR=${job_work_dir}
export SAVE_DIR=${job_work_dir}
export OUTPUT_BASE_DIR=${DATA}/stats/

# Logfile settings. Log level options are "DEBUG", "INFO", "WARNING", "ERROR", and "CRITICAL"
metric1=${METRIC//, /_}
if [ ${PTYPE} = 'time_series' ]; then
export LOG_METPLUS="${DATA}/logs/logs_plots_obs${OBTYPE}_${WVAR}_v${VALID_HOUR}z_${FHR}_${metric1}_${PTYPE}_${PERIOD}_${REGION}.out"
export LOG_METPLUS="${job_work_dir}/logs/logs_plots_obs${OBTYPE}_${WVAR}_v${VALID_HOUR}z_${FHR}_${metric1}_${PTYPE}_${PERIOD}_${REGION}.out"
elif [ ${PTYPE} = 'lead_average' ]; then
export LOG_METPLUS="${DATA}/logs/logs_plots_obs${OBTYPE}_${WVAR}_v${VALID_HOUR}z_${metric1}_${PTYPE}_${PERIOD}_${REGION}.out"
export LOG_METPLUS="${job_work_dir}/logs/logs_plots_obs${OBTYPE}_${WVAR}_v${VALID_HOUR}z_${metric1}_${PTYPE}_${PERIOD}_${REGION}.out"
fi

export LOG_LEVEL="DEBUG"
Expand Down
15 changes: 7 additions & 8 deletions parm/metplus_config/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET.conf
View file
Original file line number Diff line number Diff line change
@@ -1,23 +1,22 @@
[config]
#### Input
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/data
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/{MODEL}
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/data/{MODEL}
FCST_GRID_STAT_INPUT_TEMPLATE = {MODEL}.{init?fmt=%Y%m%d%H}.f{lead?fmt=%HHH}
FCST_GRID_STAT_INPUT_DATATYPE = GRIB
FCST_IS_PROB = False
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}/{MODEL}
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}/data/{MODEL}
OBS_GRID_STAT_INPUT_TEMPLATE = {MODEL}.{init?fmt=%Y%m%d%H}.f{lead?fmt=%HHH}
OBS_GRID_STAT_INPUT_DATATYPE = GRIB
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
15 changes: 7 additions & 8 deletions parm/metplus_config/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_NetCDF.conf
View file
Original file line number Diff line number Diff line change
@@ -1,23 +1,22 @@
[config]
#### Input
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/data
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/{MODEL}
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/data/{MODEL}
FCST_GRID_STAT_INPUT_TEMPLATE = {MODEL}.{init?fmt=%Y%m%d%H}.f{lead?fmt=%HHH}
FCST_GRID_STAT_INPUT_DATATYPE = GRIB
FCST_IS_PROB = False
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}/{MODEL}
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}/data/{MODEL}
OBS_GRID_STAT_INPUT_TEMPLATE = {MODEL}.{init?fmt=%Y%m%d%H}.f{lead?fmt=%HHH}
OBS_GRID_STAT_INPUT_DATATYPE = GRIB
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_NetCDF_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_NetCDF_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_NetCDF_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
13 changes: 6 additions & 7 deletions .../metplus_config/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obs24hrCCPA.conf
View file
Original file line number Diff line number Diff line change
@@ -1,23 +1,22 @@
[config]
#### Input
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}
FCST_GRID_STAT_INPUT_TEMPLATE = METplus_output/{ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_{ENV[VERIF_TYPE]}_24hrAccum_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/METplus_output
FCST_GRID_STAT_INPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_{ENV[VERIF_TYPE]}_24hrAccum_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DATATYPE = NETCDF
FCST_IS_PROB = False
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}
OBS_GRID_STAT_INPUT_TEMPLATE = data/ccpa/ccpa.24H.{valid?fmt=%Y%m%d%H}
OBS_GRID_STAT_INPUT_DATATYPE = NETCDF
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
13 changes: 6 additions & 7 deletions ...us_config/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obs24hrCCPA_Nbrhd.conf
View file
Original file line number Diff line number Diff line change
@@ -1,23 +1,22 @@
[config]
#### Input
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}
FCST_GRID_STAT_INPUT_TEMPLATE = METplus_output/{ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_{ENV[VERIF_TYPE]}_24hrAccum_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/METplus_output
FCST_GRID_STAT_INPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_{ENV[VERIF_TYPE]}_24hrAccum_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DATATYPE = NETCDF
FCST_IS_PROB = False
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}
OBS_GRID_STAT_INPUT_TEMPLATE = data/ccpa/ccpa.24H.{valid?fmt=%Y%m%d%H}
OBS_GRID_STAT_INPUT_DATATYPE = NETCDF
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
13 changes: 6 additions & 7 deletions ...etplus_config/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obs24hrNOHRSC.conf
View file
Original file line number Diff line number Diff line change
@@ -1,23 +1,22 @@
[config]
#### Input
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}
FCST_GRID_STAT_INPUT_TEMPLATE = METplus_output/{ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_snow_24hrAccum_{ENV[file_name_var]}_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/METplus_output
FCST_GRID_STAT_INPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_snow_24hrAccum_{ENV[file_name_var]}_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DATATYPE = NETCDF
FCST_IS_PROB = False
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}/data/nohrsc
OBS_GRID_STAT_INPUT_TEMPLATE = nohrsc.24H.{valid?fmt=%Y%m%d%H}
OBS_GRID_STAT_INPUT_DATATYPE = GRIB
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
13 changes: 6 additions & 7 deletions ..._config/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obs24hrNOHRSC_Nbrhd.conf
View file
Original file line number Diff line number Diff line change
@@ -1,23 +1,22 @@
[config]
#### Input
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}
FCST_GRID_STAT_INPUT_TEMPLATE = METplus_output/{ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_snow_24hrAccum_{ENV[file_name_var]}_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/METplus_output
FCST_GRID_STAT_INPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_snow_24hrAccum_{ENV[file_name_var]}_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DATATYPE = NETCDF
FCST_IS_PROB = False
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}/data/nohrsc
OBS_GRID_STAT_INPUT_TEMPLATE = nohrsc.24H.{valid?fmt=%Y%m%d%H}
OBS_GRID_STAT_INPUT_DATATYPE = GRIB
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
13 changes: 6 additions & 7 deletions parm/metplus_config/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obs3hrCCPA.conf
View file
Original file line number Diff line number Diff line change
@@ -1,23 +1,22 @@
[config]
#### Input
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}
FCST_GRID_STAT_INPUT_TEMPLATE = METplus_output/{ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_{ENV[VERIF_TYPE]}_3hrAccum_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/METplus_output
FCST_GRID_STAT_INPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_{ENV[VERIF_TYPE]}_3hrAccum_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DATATYPE = NETCDF
FCST_IS_PROB = False
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}
OBS_GRID_STAT_INPUT_TEMPLATE = data/ccpa/ccpa.3H.{valid?fmt=%Y%m%d%H}
OBS_GRID_STAT_INPUT_DATATYPE = GRIB
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
13 changes: 6 additions & 7 deletions ...lus_config/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obs3hrCCPA_Nbrhd.conf
View file
Original file line number Diff line number Diff line change
@@ -1,23 +1,22 @@
[config]
#### Input
INPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}
FCST_GRID_STAT_INPUT_TEMPLATE = METplus_output/{ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_{ENV[VERIF_TYPE]}_3hrAccum_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/METplus_output
FCST_GRID_STAT_INPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}/pcp_combine_{ENV[VERIF_TYPE]}_3hrAccum_init{init?fmt=%Y%m%d%H}_fhr{lead?fmt=%HHH}.nc
FCST_GRID_STAT_INPUT_DATATYPE = NETCDF
FCST_IS_PROB = False
OBS_GRID_STAT_INPUT_DIR = {INPUT_BASE}
OBS_GRID_STAT_INPUT_TEMPLATE = data/ccpa/ccpa.3H.{valid?fmt=%Y%m%d%H}
OBS_GRID_STAT_INPUT_DATATYPE = GRIB
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_Nbrhd_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
9 changes: 4 additions & 5 deletions ...fig/stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obsGHRSST_OSPO_DailyAvg.conf
View file
Original file line number Diff line number Diff line change
Expand Up @@ -10,14 +10,13 @@ OBS_GRID_STAT_INPUT_TEMPLATE = ghrsst_ospo.{valid?fmt=%Y%m%d%H?shift=-24H}to{val
OBS_GRID_STAT_INPUT_DATATYPE = NETCDF
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_DailyAvg_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_DailyAvg_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_DailyAvg_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
9 changes: 4 additions & 5 deletions ...ats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obsModelAnalysis_DailyAvgAnom.conf
View file
Original file line number Diff line number Diff line change
Expand Up @@ -10,14 +10,13 @@ OBS_GRID_STAT_INPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_
OBS_GRID_STAT_INPUT_DATATYPE = NETCDF
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_DailyAvgAnom_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_DailyAvgAnom_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_DailyAvgAnom_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
9 changes: 4 additions & 5 deletions .../stats/global_det/atmos_grid2grid/GridStat_fcstGLOBAL_DET_obsModelAnalysis_WindShear.conf
View file
Original file line number Diff line number Diff line change
Expand Up @@ -10,14 +10,13 @@ OBS_GRID_STAT_INPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_
OBS_GRID_STAT_INPUT_DATATYPE = NETCDF
OBS_IS_PROB = False
#### Output
OUTPUT_BASE = {ENV[DATA]}/{ENV[VERIF_CASE]}_{ENV[STEP]}/METplus_output
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}
GRID_STAT_OUTPUT_DIR = {ENV[job_num_work_dir]}
LOG_DIR = {GRID_STAT_OUTPUT_DIR}/logs
TMP_DIR = {ENV[MET_TMP_DIR]}
GRID_STAT_OUTPUT_TEMPLATE = {ENV[RUN]}.{valid?fmt=%Y%m%d}/{MODEL}/{ENV[VERIF_CASE]}
GRID_STAT_OUTPUT_PREFIX = {ENV[VERIF_TYPE]}_{ENV[job_name]}
LOG_METPLUS = {LOG_DIR}/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_WindShear_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.log
METPLUS_CONF = {OUTPUT_BASE}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_WindShear_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
METPLUS_CONF = {GRID_STAT_OUTPUT_DIR}/confs/{ENV[JOB_GROUP]}_GridStat_fcst{MODEL}_obs{OBTYPE}_WindShear_{ENV[VERIF_CASE]}_{ENV[STEP]}_{ENV[VERIF_TYPE]}_{ENV[job_name]}_for{VALID_BEG}_runon{CLOCK_TIME}.conf
#### METplus application
PROCESS_LIST = GridStat
#### Dates
Expand Down
Loading

0 comments on commit 68a4fc0

Please sign in to comment.