-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update environment #28
Conversation
environment.yml
Outdated
# - dask-deltatable | ||
- pip | ||
- pip: | ||
- git+https://github.com/fjetter/dask-deltatable.git@dask_expr | ||
- git+https://github.com/dask-contrib/dask-deltatable.git@7706c22aa07f978f481ca4996dce8ca0121c812e |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks like dask-deltatable==0.3.3
should fix the issue you ran into? dask-contrib/dask-deltatable#81
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yup that works!
@@ -17,8 +16,8 @@ dependencies: | |||
- s3fs | |||
- universal_pathlib <0.2.0 | |||
- boto3 | |||
- deltalake=0.15.3 | |||
- deltalake >=0.18 | |||
# - dask-deltatable |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
# - dask-deltatable | |
- dask-deltatable=0.3.3 |
- pip: | ||
- git+https://github.com/fjetter/dask-deltatable.git@dask_expr | ||
- dask-deltatable==0.3.3 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can remove this now
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I had to pip install it for things to work
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hmm that's strange but 🤷
Updating some of these packages since dask-expr was incorporated into dask dataframe. The only one I had some trouble with was dask-deltatable (see dask-contrib/dask-deltatable#81)