Template for websites like vast.ai

[RenNagasaki]

Is your feature request related to a problem? Please describe.

Describe the solution you'd like
Hey, I'd like an easy to use template for https://cloud.vast.ai since that seems like a better solution than google collab and stuff (regarding prices and available hardware)

Describe alternatives you've considered

Additional context
Training on my personal use computer isnt that feasible, since I want to game 🤣, so I took a look around the internet to rent a machine with really good hardware and found vast.ai . This seems perfect for my use case. I could create my own personal use template but that would take quite long, so if you think you could accomplish that faster, i'd be happy. If not i'll try to create one myself.

Kind regards,
Ren

[erew123]

Hi @RenNagasaki Hope you're well! There are 2x things going on right at the moment, both somewhat out of my hands (as Im super busy with other bits). First which is probably most critical to your request is that one person is working on the docker builds and this will be key to anything like the solution above because it will be a docker environment underneath it..... #378

Then the other thing that is happening is further research and tweaking with the finetune to improve it its in the PR's, so there assumedly will be an update to that at some point soon.

The docker thing is probably the kicker here... I'm no docker expert in the slightest, but I think you will find the docker template (when its built) will probably work as a template across all those sorts of cloud systems.

[mercuryin]

Hi Ren,

I’m in the same situation. I don’t have the knowledge to create a template for Vast.ai or Modal.com servers. I’ve tried using ChatGPT to help me, but haven’t had much luck. If you manage to get it working and wouldn’t mind sharing it with me, please let me know.

[vlrevolution]

I have successfully installed and run alltalk in vast.ai machine on top of this: https://hub.docker.com/r/pytorch/pytorch

Base installation script worked perfectly. In theory there's not much more to creating a docker image. Just use that as base and run installation of alltalk which takes care of everything.. however you do have to make the networking work (specify ports etc), which might take some extra work in vast.ai, docs are found here: https://docs.vast.ai/docker-execution-environment

[vlrevolution]

The actual Dockerfile can be seen here:
https://github.com/pytorch/pytorch/blob/main/Dockerfile