Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proper repo workflow #191

Closed
twsl opened this issue Jun 13, 2024 · 4 comments
Closed

Proper repo workflow #191

twsl opened this issue Jun 13, 2024 · 4 comments

Comments

@twsl
Copy link

twsl commented Jun 13, 2024

Let's assume i have python project git repo locally where i developed a library and have some notebooks to execute said code.
how can i properly sync my code between my local folder and the specific repo user folder on databricks?
The reason i need full sync support is because i want to install the library from within the repo so i can import it into the notebooks.

The original databricks extension lets me sync my code to a folder in the user directory, but a feature to properly sync to the repo folder seems to be missing from both folders.

@gbrueckl
Copy link
Collaborator

please check Execution modes

if you are in offline-mode you can download/sync a whole Repo-folder

when referencing a library from your Repo, it will always use the deployed version of the library
however, you can also change your library locally and upload it

@twsl
Copy link
Author

twsl commented Jun 25, 2024

I looked through the execution modes, but they don't seem to be suited to my needs.
The live execution mode doesn't work, because of databricks shitty git limitations (e.g. git repos don't support git submodules), the offline execution doesnt offer support for full repo sync and doesnt allow me to set the sync location for the whole vscode workspace.

@gbrueckl
Copy link
Collaborator

what exactly do you mean by "full repo sync"?
you can sync everything that you have local to the Databricksworkspace

@gbrueckl
Copy link
Collaborator

closed due to inactivity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants