Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rearrange repo, add docs, update results #17

Open
wants to merge 44 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
4e442ee
moved systems
kessel Oct 8, 2021
b8d6f08
added everything to Helmholtz AI folder
kessel Oct 8, 2021
46d7320
modified for submission
kessel Oct 8, 2021
25076b8
fixed logs
kessel Oct 8, 2021
7587bff
added missing systems
kessel Oct 8, 2021
0e31c9b
added docs
kessel Oct 8, 2021
598632e
added docs
kessel Oct 8, 2021
52c3475
added docs
kessel Oct 8, 2021
598aed8
Update cosmoflow results
janEbert Oct 8, 2021
922ce2d
Filter updated results
janEbert Oct 8, 2021
a0d48ba
Add 10-instance weak scaling script
janEbert Oct 8, 2021
f196d14
Clean up whitespace
janEbert Oct 8, 2021
45f1573
Fix typos
janEbert Oct 8, 2021
9dc8dc1
Clean up whitespace
janEbert Oct 8, 2021
cf67c2d
Fix typos
janEbert Oct 8, 2021
bb770bb
Fix dissimilarities from DeepCAM README
janEbert Oct 8, 2021
2466258
Adjust DeepCAM code paths
janEbert Nov 8, 2021
62b025e
Adjust cached scratch location
janEbert May 10, 2022
8448eab
Adjust CosmoFlow code paths
janEbert May 10, 2022
230b0de
Adjust project name
janEbert May 10, 2022
6bf1010
Remove erroneous path separator
janEbert May 10, 2022
b46862a
Move run scripts to separate directory
janEbert May 10, 2022
72434b7
Always create output directories
janEbert May 10, 2022
28a6fba
Automatically format output directory
janEbert May 10, 2022
d227831
Fix account name
janEbert May 10, 2022
201aa77
Update HDF5 conversion scripts
janEbert May 10, 2022
0223609
Use same number of GPUs as tasks per node
janEbert May 18, 2022
eea680f
Refactor IME conditionals
janEbert May 18, 2022
f4ebedf
Adjust paths
janEbert May 18, 2022
fd555e6
Add optional IME usage
janEbert May 18, 2022
152c6e2
Adjust data paths
janEbert May 18, 2022
2c25cce
Allow running with invalid configuration
janEbert May 18, 2022
e58aec3
Increase number of nodes required for prestaging
janEbert May 19, 2022
46927c9
Set different seed automatically
janEbert May 19, 2022
e8ec724
Do not switch preshuffling if using HDF5
janEbert May 19, 2022
b70a69a
Make sure data is in cache
janEbert May 19, 2022
f1426d8
total final updates for 2021
coquelin77 May 19, 2022
18c0a17
Execute container runscript
janEbert May 19, 2022
3bc5916
Merge pull request #5 from janEbert/main
kessel May 19, 2022
cdd514b
Rename Singularity -> Apptainer
janEbert May 24, 2022
3861325
Adjust directories to be user-specific
janEbert May 24, 2022
448bbe0
Automatically select JUWELS Booster partition
janEbert May 25, 2022
6ff0f2d
Print IME usage
janEbert May 25, 2022
cec0cf9
Do not use HDF5 file locking
janEbert May 25, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Execute container runscript
Just for safety.
janEbert committed May 19, 2022
commit 18c0a17d97e39ca4bcafaaaf801250bdad3b2e23
Original file line number Diff line number Diff line change
@@ -67,7 +67,7 @@ fi
echo "${CONFIG_FILE}"
cat "${CONFIG_FILE}"

srun "${SRUN_PARAMS[@]}" singularity exec --nv \
srun "${SRUN_PARAMS[@]}" singularity run --nv \
--bind "${DATA_DIR_PREFIX}":/data,/tmp:"${STAGING_AREA}","${RESULTS_ROOT}":/results,${SCRIPT_DIR},${OUTPUT_ROOT} \
${SINGULARITY_FILE} \
bash -c "\