Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

allow to use colab secrets via config provider #1038

Open
rudolfix opened this issue Mar 1, 2024 · 0 comments
Open

allow to use colab secrets via config provider #1038

rudolfix opened this issue Mar 1, 2024 · 0 comments

Comments

@rudolfix
Copy link
Collaborator

rudolfix commented Mar 1, 2024

Background
Colab added a feature to specify secrets that you can then access in the code:
image

Tasks
Implement extra config provider that works like the airflow one.

  1. adds itself when colab runtime is present (we have detector utils)
  2. is based off the regular toml provider
  3. emulates secrets.toml and config.toml, you just load them from the properly named colab secrets
  4. contrary to existing toml reader which does not reload, this one must check for changes. so introduce a cache (ie with a few seconds default expiration) that will reload the whole document on get. add cache to the base toml (disabled by default)
  5. make sure we do not have obnoxious behavior ie. asking for permissions every second
  6. I suggest prototyping in colab. you can add providers dynamically to container
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant