Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release v16.3.22 optimized point output #3257

Open
wants to merge 22 commits into
base: release/gfs.v16.3.22
Choose a base branch
from
+101 −299
Open

Release v16.3.22 optimized point output #3257

Show file tree
Hide file tree
Changes from 21 commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
a2ba32b
optimized the ww3_outp, issue #3157
AliS-Noaa Dec 30, 2024
8086f49
cleaned the outp script, issue #3157
AliS-Noaa Jan 3, 2025
84fc8f3
changing the point output script and cleaning it and changing the res…
AliS-Noaa Jan 7, 2025
d2b6b70
concising the exgfs_wave_post_pnt.sh and config files, issue #3157
AliS-Noaa Jan 8, 2025
d122080
fixing tar script for the optimized point output, issue #3157
AliS-Noaa Jan 21, 2025
8e2ad85
retreiving the file counting, issue #3157
AliS-Noaa Jan 21, 2025
0772d72
Merge remote-tracking branch 'origin/devgfs/pointupdate' into release…
AliS-Noaa Jan 24, 2025
1a9b7f9
Revising the checkout.sh
AliS-Noaa Jan 24, 2025
5784053
fixing the links to inputs for wave post script
AliS-Noaa Jan 28, 2025
14059bf
Updatuing the Release_Notes.md for wave point output update
AliS-Noaa Jan 28, 2025
4a2c51b
minor revision in the Release_Notes.md
AliS-Noaa Jan 28, 2025
25f6086
another minor correction to the Release_Notes.md
AliS-Noaa Jan 28, 2025
53f8172
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
61e3577
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
0892513
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
b2220cc
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
52558ac
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
e22af6b
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
aaf1a46
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
de078f6
adding two wave jobs for testing to the Release note
AliS-Noaa Jan 28, 2025
14bb68f
adding sperate log file for each wave post point jobs
AliS-Noaa Jan 29, 2025
9ae2e74
adding the tag to checkout.sh and also some minor revision of the rel…
AliS-Noaa Jan 29, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
31 changes: 21 additions & 10 deletions docs/Release_Notes.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,10 @@ GFS V16.3.22 RELEASE NOTES
-------
PRELUDE
-------

The upstream OBSPROC package is updated to v1.3. Along with this are the following companion updates:
* workflow and UFS_UTILS package updates to use the new AFWA global snow file due to the hemispheric snow files being phased out
* updated GSI code and convinfo file for saildrone observations
* ww3_outp is improved for the wave point output

IMPLEMENTATION INSTRUCTIONS
---------------------------
Expand All @@ -26,7 +26,7 @@ The checkout script extracts the following GFS components:

| Component | Tag | POC |
| --------- | ----------- | ----------------- |
| MODEL | GFS.v16.3.1 | [email protected] |
| MODEL | GFS.v16.3.22 | [email protected] |
| GLDAS | gldas_gfsv16_release.v.2.1.0 | [email protected] |
| GSI | gfsda.v16.3.22 | [email protected] |
| UFS_UTILS | ops-gfsv16.3.20 | [email protected] |
Expand All @@ -51,13 +51,14 @@ cd ../ecf
VERSION FILE CHANGES
--------------------

* `versions/run.ver` - change `version=v16.3.22`, `gfs_ver=v16.3.22`, and `obsproc_ver=v1.3`
* * `versions/run.ver` - change `version=v16.3.22`, `gfs_ver=v16.3.22`, and `obsproc_ver=v1.3`
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please remove the addition of a second asterix.


SORC CHANGES
------------

* New UFS_UTILS tag - `emcsfc_snow2mdl` program and associated scripts are updated to process global AFWA snow data
* New GSI tag - `src/gsi/read_prepbufr.f90` code update for new saildrone subtype
* New MODEL tag - WW3 program `ww3_outp` and associated scripts are improved to process the per-time-step point outputs more efficiently.

JOBS CHANGES
------------
Expand All @@ -67,17 +68,17 @@ JOBS CHANGES
PARM/CONFIG CHANGES
-------------------

* No changes from GFS v16.3.21
* `config.resources.emc.dyn` and `config.resources.nco.static` are changed to reduce the resources accordingly.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reduce the resources of what? Since this package includes multiple things now, please specify what job resources are changing.


SCRIPT CHANGES
--------------

* No changes from GFS v16.3.21
* `scripts/exgfs_wave_post_pnt.sh` is changed to create be compatible with the new `ww3_outp`.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review wording in this comment.


FIX CHANGES
-----------

* GSI `global_convinfo.txt` fix update for saildrone
* GSI `global_convinfo.txt` fix update for saildrone```
Copy link
Member

@KateFriedman-NOAA KateFriedman-NOAA Jan 29, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove the three ` at end of line


MODULE CHANGES
--------------
Expand All @@ -88,23 +89,31 @@ CHANGES TO FILE AND FILE SIZES
------------------------------

No longer ingest:
* `${RUN}.${cycle}.NPR.SNWN.SP.S1200.MESH16.grb` (`AFWA_NH_FILE`)
* `${RUN}.${cycle}.NPR.SNWN.SP.S1200.MESH16.grb` (`AFWA_NH_FILE`)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove added spaces on line 92

* `${RUN}.${cycle}.NPR.SNWS.SP.S1200.MESH16.grb` (`AFWA_SH_FILE`)

Now ingest:
Now ingest:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove added spaces (or tab) on line 95

* `${RUN}.${cycle}.snow.usaf.grib2` (`AFWA_GLOBAL_FILE`)

No longer uses the parallel command file `cmdfile` for the `scripts/exgfs_wave_post_pnt.sh`.
AliS-Noaa marked this conversation as resolved.
Show resolved Hide resolved


ENVIRONMENT AND RESOURCE CHANGES
--------------------------------

* Increase ncpus from 50 to 60 for gfs_wave_postpnt job.
NCO provided change to avoid ncpu burst warnings.
Reduce the ncpu and wtime as follow:
* for jobs/JGLOBAL_WAVE_POST_BNDPNT; ncpu from 240 to 1; wtime from 1hr to 30min
* for jobs/JGLOBAL_WAVE_POST_BNDPNTBLL; ncpu from 448 to 2; wtime from 1hr to 10min
* for jobs/JGLOBAL_WAVE_POST_PNT; ncpu from 200 to 3; wtime from 1.5hr to 35min

PRE-IMPLEMENTATION TESTING REQUIREMENTS
---------------------------------------

* Which production jobs should be tested as part of this implementation?
* emcsfc_sfc_prep and analysis
* wave_post_pnt
AliS-Noaa marked this conversation as resolved.
Show resolved Hide resolved
* wave_post_bndpnt
* wave_post_bndpntbll
* Does this change require a 30-day evaluation?
* No

Expand Down Expand Up @@ -133,3 +142,5 @@ PREPARED BY
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
4 changes: 2 additions & 2 deletions ecf/scripts/gfs/wave/post/jgfs_wave_post_bndpnt.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
#PBS -j oe
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=01:00:00
#PBS -l select=3:ncpus=80:ompthreads=1
#PBS -l walltime=00:30:00
#PBS -l select=1:ncpus=1:ompthreads=1
#PBS -l place=vscatter:exclhost
#PBS -l debug=true

Expand Down
4 changes: 2 additions & 2 deletions ecf/scripts/gfs/wave/post/jgfs_wave_post_bndpntbll.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
#PBS -j oe
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=01:00:00
#PBS -l select=4:ncpus=112:ompthreads=1
#PBS -l walltime=00:10:00
#PBS -l select=1:ncpus=2:ompthreads=1
#PBS -l place=vscatter:exclhost
#PBS -l debug=true

Expand Down
4 changes: 2 additions & 2 deletions ecf/scripts/gfs/wave/post/jgfs_wave_postpnt.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
#PBS -j oe
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=01:30:00
#PBS -l select=4:ncpus=60:ompthreads=1
#PBS -l walltime=00:35:00
#PBS -l select=1:ncpus=3:ompthreads=1
#PBS -l place=vscatter:exclhost
#PBS -l debug=true

Expand Down
18 changes: 9 additions & 9 deletions parm/config/config.resources.emc.dyn
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -90,26 +90,26 @@ elif [ $step = "wavepostsbs" ]; then

elif [ $step = "wavepostbndpnt" ]; then

export wtime_wavepostbndpnt="01:00:00"
export npe_wavepostbndpnt=240
export wtime_wavepostbndpnt="00:30:00"
export npe_wavepostbndpnt=1
export nth_wavepostbndpnt=1
export npe_node_wavepostbndpnt=80
export npe_node_wavepostbndpnt=${npe_wavepostbndpnt}
export NTASKS=$npe_wavepostbndpnt

elif [ $step = "wavepostbndpntbll" ]; then

export wtime_wavepostbndpntbll="01:00:00"
export npe_wavepostbndpntbll=448
export wtime_wavepostbndpntbll="00:10:00"
export npe_wavepostbndpntbll=2
export nth_wavepostbndpntbll=1
export npe_node_wavepostbndpntbll=112
export npe_node_wavepostbndpntbll=${npe_wavepostbndpntbll}
export NTASKS=$npe_wavepostbndpntbll

elif [ $step = "wavepostpnt" ]; then

export wtime_wavepostpnt="01:30:00"
export npe_wavepostpnt=200
export wtime_wavepostpnt="00:35:00"
export npe_wavepostpnt=3
export nth_wavepostpnt=1
export npe_node_wavepostpnt=60
export npe_node_wavepostpnt=${npe_wavepostpnt}
export NTASKS=$npe_wavepostpnt

elif [ $step = "wavegempak" ]; then
Expand Down
18 changes: 9 additions & 9 deletions parm/config/config.resources.nco.static
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -74,26 +74,26 @@ elif [ $step = "wavepostsbs" ]; then

elif [ $step = "wavepostbndpnt" ]; then

export wtime_wavepostbndpnt="01:00:00"
export npe_wavepostbndpnt=240
export wtime_wavepostbndpnt="00:30:00"
export npe_wavepostbndpnt=1
export nth_wavepostbndpnt=1
export npe_node_wavepostbndpnt=80
export npe_node_wavepostbndpnt=${npe_wavepostbndpnt}
export NTASKS=$npe_wavepostbndpnt

elif [ $step = "wavepostbndpntbll" ]; then

export wtime_wavepostbndpntbll="01:00:00"
export npe_wavepostbndpntbll=448
export wtime_wavepostbndpntbll="00:10:00"
export npe_wavepostbndpntbll=2
export nth_wavepostbndpntbll=1
export npe_node_wavepostbndpntbll=112
export npe_node_wavepostbndpntbll=${npe_wavepostbndpntbll}
export NTASKS=$npe_wavepostbndpntbll

elif [ $step = "wavepostpnt" ]; then

export wtime_wavepostpnt="01:30:00"
export npe_wavepostpnt=200
export wtime_wavepostpnt="00:35:00"
export npe_wavepostpnt=3
export nth_wavepostpnt=1
export npe_node_wavepostpnt=60
export npe_node_wavepostpnt=${npe_wavepostpnt}
export NTASKS=$npe_wavepostpnt

elif [ $step = "wavegempak" ]; then
Expand Down
Loading