Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Explore loading speed and subsetting for global orca domain #626

Open
b-barton opened this issue Oct 19, 2023 · 0 comments
Open

Explore loading speed and subsetting for global orca domain #626

b-barton opened this issue Oct 19, 2023 · 0 comments

Comments

@b-barton
Copy link
Collaborator

Loading global data and taking a subset for computing heat content on 1 year of data takes varying time according to the method:

  • with COAsT it took over 1h15 (it actually didn't finish because of a bug),
  • with Xarray and the preprocessing partial function it took 12m55,
  • with Dask it took 6m47.

Does this bug in (1) still exist?
Investigate feasibility of implementing speed ups in COAsT.

AC:

  • Create ticket for bug

  • Propose ticket for speeding up COAsT users (ideally a solution using COAsT.gridded() but worse case e.g. just ADDITIONAL documentation about how to use Dask.
@jpolton jpolton moved this to MSM - todo in COAsT_dev Oct 24, 2023
@thogar-computer thogar-computer moved this from MSM - todo to MSM - in progress in COAsT_dev Oct 31, 2023
@thogar-computer thogar-computer moved this from MSM - in progress to Merged to Develop in COAsT_dev Oct 31, 2023
@thogar-computer thogar-computer moved this from Merged to Develop to MSM - todo in COAsT_dev Oct 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
COAsT_dev
Status: MSM - todo
Milestone
No milestone
Development

No branches or pull requests
1 participant
@b-barton