Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Show size of remote datasets #90

Open
ScottWales opened this issue Aug 14, 2019 · 0 comments
Open

Show size of remote datasets #90

ScottWales opened this issue Aug 14, 2019 · 0 comments

Comments

@ScottWales
Copy link
Contributor

When checking for datasets available on ESGF but not locally, also retrieve the dataset size (I assume that’s available through the API, it’s displayed on the web in bytes I think), so you can estimate the volume of your request to judge whether it’s reasonable to submit to NCI. Ideally provide a total volume for –remote output list (e.g. if 10 missing datasets are identified, rather than displaying 10 dataset sizes provide a single total volume required to match this request).

Synda does this calculation when checking for requests and can ask for confirmation before proceeding to download, so I assume it is possible but I don’t know if it’s crazy overhead or hard to implement.

At the moment the volume stored at NCI is pretty modest but some of the additional things I’m tempted to request might be incremental (e.g. all fx vars), others might be crazy (variables from highresMIP and DCPP, e.g.).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants