Utilize a benchmarking tool to generate benchmarking metrics for the ensemble stat tool

[bikegeek]

Describe the Task

Utilize a benchmarking tool to generate benchmarking/performance metrics when running the ensemble stat tool.

Provide support for:

• Running multiple METplus use cases
• Running a single MET command line command
• Save output generated by the benchmarking tool into a consolidated file (.csv and .txt)
• Allow user to determine how many times the ensemble stat tool is to be run
• Create output files that have the timestamp of when the benchmarking was performed

Time Estimate

1-2 weeks

Sub-Issues

Consider breaking the task down into sub-issues.

• Identify tool for generating benchmarking metrics
• Obtain data and METplus configuration files for development
• create support for running multiple METplus use cases
• create support for running MET ensemble stat tool
• document background information on the benchmarking tool and how it is set up and used.

Relevant Deadlines

end of period of performance is January 31, 2025

Funding Source

2771024 (AF)

Define the Metadata

Assignee

• Select **engineer(s)**Minna Win
• Select scientist(s) Michelle Harrold

Labels

• Review default alert labels
• Select component(s)
• Select priority
• Select requestor(s)

Milestone and Projects

• Select Milestone as a MET-X.Y.Z version, Consider for Next Release, or Backlog of Development Ideas
• For a MET-X.Y.Z version, select the MET-X.Y.Z Development project

Define Related Issue(s)

Consider the impact to the other METplus components.

• METplus, MET, METdataio, METviewer, METexpress, METcalcpy, METplotpy

Task Checklist

See the METplus Workflow for details.

• Complete the issue definition above, including the Time Estimate and Funding Source.
• Fork this repository or create a branch of develop.
  Branch name: feature_<Issue Number>_<Description>
• Complete the development and test your changes.
• Add/update log messages for easier debugging.
• Add/update unit tests.
• Add/update documentation.
• Push local changes to GitHub.
• Submit a pull request to merge into develop.
  Pull request: feature <Issue Number> <Description>
• Define the pull request metadata, as permissions allow.
  Select: Reviewer(s) and Development issue
  Select: Milestone as the next official version
  Select: MET-X.Y.Z Development project for development toward the next official release
• Iterate until the reviewer(s) accept and merge your changes.
• Delete your fork or branch.
• Close this issue.