Support ROCm

[nonetrix]

Since there is only a bug issue template I will assume it is the wrong place to ask, but ROCm support for Linux users and possibly Windows users would be really nice. Thanks for the awesome work :)

[EricLBuehler]

I think ROCm support would be great. I've been looking at ZLUDA, which is a CUDA -> HIP transpiler and seems pretty promising!

[nonetrix]

I personally tried it on a few things and didn't have good luck, but might have diffrent results. A another alternative would be to just use Vulkan compute, I personally think might be the way forward cross platform wise. It's about the same speed as ROCm in my experience actually but of course I imagine it is harder to implement. Could be solved by making a nice wrapper around it I imagine that just takes the same role of ROCm or CUDA instead of being more general, but I don't think anyone has done that yet really