Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to 2024 RIKEN tutorial for DYAD #29

Merged
merged 35 commits into from
Apr 12, 2024
Merged
Changes from 1 commit
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
9db7e92
Updates Dockerfile.spawn and requirements.txt to handle the newest ve…
ilumsden Apr 4, 2024
a4c730b
Moves copy/move of tutorial materials into the root user block
ilumsden Apr 4, 2024
4adc40d
Adds intro, tutorial code cells, and extra dependencies to DYAD porti…
ilumsden Apr 5, 2024
41bb218
Adds cleanup for the data generation directory in DYAD portion of tut…
ilumsden Apr 5, 2024
c4e3f8c
Current progress and debugging
ilumsden Apr 10, 2024
223afdc
DLIO version of the Docker file.
hariharan-devarajan Apr 10, 2024
fe854e1
Starts to break the tutorial down into modules
ilumsden Apr 10, 2024
f036fa2
Minor text changes to 02_flux_scheduling.ipynb
ilumsden Apr 10, 2024
560a48e
Adds a description of the scheduling policies used in flux tree example
ilumsden Apr 10, 2024
223861e
Adds an image for flux tree
ilumsden Apr 10, 2024
72d56e4
Adds attribution to images
ilumsden Apr 10, 2024
26f6834
Adds module labels throughout tutorial
ilumsden Apr 10, 2024
89980ed
Adds Flux logo to other notebooks
ilumsden Apr 10, 2024
eaf4b1a
Makes a couple of fixes for DLIO use case
ilumsden Apr 11, 2024
50d7cd6
Last few bugfixes in DYAD notebook
ilumsden Apr 11, 2024
0ab14fc
Minor changes to Flux scheduling notebook to correct job waiting
ilumsden Apr 11, 2024
13cc28c
Moves the YouTube video in the intro to a code cell so it will work i…
ilumsden Apr 11, 2024
b1a3143
Adds DYAD to LD_LIBRARY_PATH before launching DLIO
ilumsden Apr 11, 2024
07033e1
Renames dyad_dlio.ipynb to 04_dyad_dlio.ipynb
ilumsden Apr 11, 2024
03f62e6
Updates Dockerfile.spawn to get the DLIO use case working
ilumsden Apr 11, 2024
9af1117
Adds a tutorial-specific copy of the DYAD Torch data loader
ilumsden Apr 11, 2024
9d1fecd
Minor bugfixes after moving DLIO extensions into the repo
ilumsden Apr 11, 2024
1613907
Simplifies the DYAD Torch data loader
ilumsden Apr 11, 2024
a874218
Adds reference to LC table and flux proxy optional section
ilumsden Apr 11, 2024
5428b9a
Adds a step to docker-builds to remove unneeded stuff from runner
ilumsden Apr 11, 2024
58ed703
Small consistency tweaks
ilumsden Apr 11, 2024
fc7e37b
Adds module 3
ilumsden Apr 11, 2024
f84cd2c
Small summary change
ilumsden Apr 11, 2024
96897bb
Editing and revisions
ilumsden Apr 12, 2024
0d01733
Finishes the DYAD notebook
ilumsden Apr 12, 2024
f24bbed
Adds the supplement and updates the conclusions
ilumsden Apr 12, 2024
14108ca
Tweaks a figure width
ilumsden Apr 12, 2024
55e27e2
Removes dead changes for testing DLIO
ilumsden Apr 12, 2024
7051f86
Tries uncommenting the rm on apt lists
ilumsden Apr 12, 2024
0cb3fb0
Removes the old DYAD notebook from previous years since it's been sup…
ilumsden Apr 12, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Small summary change
ilumsden committed Apr 11, 2024
commit f84cd2cd6ea573ef3069fa090f252cf5589588e8
Original file line number Diff line number Diff line change
@@ -85,6 +85,8 @@
"\n",
"# This concludes Module 1.\n",
"\n",
"In this module, we introduced Flux and showed how to get started with Flux, particularly on systems using a different system-wide scheduler.\n",
"\n",
"Next, we will see how to use Flux for both traditional batch scheduling and hierarchical scheduling. To continue, open [02_flux_scheduling.ipynb](./02_flux_scheduling.ipynb)."
]
},