Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: Added jupyter-pytorch-notebook Dockerfile #67

Merged
merged 3 commits into from
Nov 15, 2024

Conversation

Neonbluestoplight
Copy link
Contributor

Installs pytorch, transformers, accelarate, bitsandbytes using mamba

@Neonbluestoplight
Copy link
Contributor Author

Currently pytorch notebook test is failing because the image is close to max cap of GitHub actions space provisions

@Neonbluestoplight Neonbluestoplight marked this pull request as draft November 14, 2024 10:04
@Neonbluestoplight Neonbluestoplight force-pushed the add_jupyter_pytorch_notebook branch from 31f292a to 15742c8 Compare November 14, 2024 11:44
@Neonbluestoplight Neonbluestoplight marked this pull request as ready for review November 14, 2024 11:59
mamba was causing problems with pytorch CUDA compatibility so used pip for installing the required packages instead
@Neonbluestoplight Neonbluestoplight force-pushed the add_jupyter_pytorch_notebook branch from 5fcecb7 to 3050395 Compare November 15, 2024 12:45
Copy link
Contributor

@lizsalmon lizsalmon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

I don't know if it is possible or not but could you provide versions for transformers, accelerate etc, so that it is more reproducible?

fix-permissions "${CONDA_DIR}" && \
fix-permissions "/home/${NB_USER}"
#switch back to jovyan to avoid accidental container runs as root
USER ${NB_UID}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if it changes anything but does it matter if this variable has the curly braces, whereas on line 11 it is written without them USER $NB_UID.

Otherwise it all looks good to me

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think there is a difference between the two, but it keeps it consistent with how we switch back to user in our other dockerfiles

@Dmitry-Popovichev Dmitry-Popovichev merged commit 2a1fad2 into master Nov 15, 2024
20 of 22 checks passed
@Dmitry-Popovichev Dmitry-Popovichev deleted the add_jupyter_pytorch_notebook branch November 15, 2024 15:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants