Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Need to update backend to use Float32 directly instead of Int16 #14

Open
4 tasks
natgeo-wong opened this issue Feb 6, 2025 · 0 comments
Open
4 tasks

Comments

@natgeo-wong
Copy link
Member

natgeo-wong commented Feb 6, 2025

ECMWF has updated their datasets on CDS such that the data is no longer provided in Int16 format, but instead directly provided as Float32 data. There is thus a need to change all the backends to natively interact with Float32 formats without needing conversion.

This will require another breaking change from v0.3 to v0.4 (so v0.3 will be the last version that interacts with Int16 formats because I would assume that eventually the Int16 data would be phased out in favour of Float32).

Things to do:

  • Go through the code and change all preallocated arrays to Float32 types instead of Int16
  • Remove the need for attributes, all missing data is saved as NaN types
  • Directly load all into Float32 arrays and not Int16 arrays
  • Bump to the next breaking version to denote this change
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant