Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shared sea ice model performance metrics #505

Open
rgrumbine opened this issue Aug 17, 2020 · 2 comments
Open

Shared sea ice model performance metrics #505

rgrumbine opened this issue Aug 17, 2020 · 2 comments

Comments

@rgrumbine
Copy link
Contributor

A starting point for consideration is at https://github.com/rgrumbine/ice_scoring

This is organized largely by parameter to be examined -- concentration field, ice edge, ice drift being the most developed.

@eclare108213
Copy link
Contributor

@rgrumbine Here is the paper I mentioned in the meeting today:
Urrego-Blanco, J. R., E. C. Hunke, N. M. Urban, N. Jeffery, A. K. Turner, J. R. Langenbrunner, and J. M. Booker (2017), Validation of sea ice models using an uncertainty-based distance metric for multiple model variables, J. Geophys. Res. Oceans, 122, doi:10.1002/2016JC012602.?

@rgrumbine
Copy link
Contributor Author

Excellent! I've done a quick glance through, and it doesn't look like there would be any difficulty in adapting/adding this measure in to the setup I already have.

Particularly important/useful is considering the Pareto front. Mention of that also puts me in mind of evolutionary methods for multiobjective optimisation.

For ice drift/motion evaluation, I considered 13 different measures in https://polar.ncep.noaa.gov/mmab/papers/tn315/ and arrived at 5 being meaningful and independent. For favorite, error radius. Codes still compute all 13.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants