Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Elastic scheduling #488

Open
pearce8 opened this issue Dec 10, 2024 · 0 comments
Open

Elastic scheduling #488

pearce8 opened this issue Dec 10, 2024 · 0 comments
Assignees
Labels
feature New feature or request

Comments

@pearce8
Copy link
Collaborator

pearce8 commented Dec 10, 2024

Currently, in a config directory, would template the yaml to submit to EKS. ramble on while running on laptop, could use a templated container for kubernetes. Then the EKS job installs Spack and Ramble into the kubernetes container. There are commands to install spack and Ramble that inject commands.

There are also ramble deployments (push and pull) so Ramble can take an activated workspace and group them into an artifact repository to push to an s3 bucket; then the EKS job would make a workspace and pull from the same job that you pushed.

Later, there will be a feature to have workflow managers as well as package managers, to make it a one-line change to run on EKS instead of slurm.

There may be overlap between functionality we need for containers/eks/sandboxed machines.

@pearce8 pearce8 added the feature New feature or request label Dec 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants