Ampere support

[judge2020]

An RTX A4000 was spotted, presumably built on GA104, so we should be on the look-out for a new driver that supports this GPU and test it out on existing consumer-grade 30-series cards.

[KrutavShah]

Can we rename this issue to Ampere Support? The reality is, we haven't even gotten the GA102 cards working yet, so we are all hard at work figuring out.

Currently, the latest vGPU driver is 460.32.04 which supports GA102 but no sign of GA104 yet. One thing to note as well is that Nvidia doesn't constantly release these drivers since they are part of enterprise product, so updates are going to be a bit slow to come, with GA104 support coming when the card is released.

[grandprixgp]

Any plans for AMD support in the future?

[KrutavShah]

AMD support should be relatively the same to achieve: spoof PCI ID and do some IOCTL stuff and then we will be able to achieve SRIOV on cards like RX 480 and a few select others.

[DualCoder]

AMD GPUs will not be supported by vgpu_unlock. That would have to be a separate project.

[grandprixgp]

AMD GPUs will not be supported by vgpu_unlock. That would have to be a separate project.

Is there a specific reason? If a similar method was achievable and a PR was submitted you wouldn't be interested?

[lambdatastic]

Is there a specific reason?

The underlying tech is different / custom for each manufacturer, so the finer details of the workaround for Nvidia vGPU won't work for AMD's MxGPU / general SR-IOV. I'd imagine that's the reason to keep an AMD project separate.

[marcosscriven]

I have an RTX3080 - is there anything I can do or try that would help here?

[olealgoritme]

If anyone spots the RTX A5000 vGPU profiles, we could start testing with these for ampere :)
From the looks of it, RTX A4000 does not support vGPU.

[leo60228]

Is the A5000 expected to receive vGPU support? I assumed that it wouldn't, similarly to the Quadro RTX 5000.

[leo60228]

The A10 launched very recently and is the successor to the Tesla T4. However, it isn't supported in the public drivers yet, and it uses a GA102 like the A6000...

[leo60228]

Oh, wait, did you just mean any GRID drivers with support for Ampere? I have the latest GRID drivers.

[olealgoritme]

Is the A5000 expected to receive vGPU support? I assumed that it wouldn't, similarly to the Quadro RTX 5000.

Yes, A5000 will have vGPU support.
https://www.nvidia.com/en-us/design-visualization/rtx-a5000/

[leo60228]

Hm, you're right... I assumed they would've released the drivers by now, since the cards officially launched a couple weeks ago (though I can't find anywhere to buy them).

[KrutavShah]

All new GPUs capable of vGPU announced at GTC 2021 should be available for use with R470 drivers. Hopefully, they will release in a few months or so, and we will be able to obtain them to do testing. Note that currently, it seems that only GA107 and GA102 support vGPU, not sure if GA104 does.

[fidelix]

Any news on GA104 support?

[ahmeteminkocal]

If Nvidia does a little suprise and enables SR-IOV on 3090's,
Nevermind, they will not.

[kaprog]

Any news regarding Ampere support?

[DualCoder]

No news at this time.

Current status is unchanged: The guest driver crashes on startup due to a null-pointer dereference. It is unknown if this is due to a bug in the driver or if SR-IOV is required for the driver to function. AFAIK nobody is actively working on this at this time.

[Silvermane06]

I did just get an a4000 in, so if there's anything I could do to maybe help, then I wouldn't mind doing so, though I imagine the problem is a software restriction imposed by nvidia (due to the null-pointer dereference), thus making me unable to really help, not to mention the fact the a4000 doesn't even support vGPU officially, let alone unofficially.

[ahmeteminkocal]

Any news?

[ahmeteminkocal]

Still no luck I guess.

[PAI5REECHO]

Significant portions of Nvidia driver source were made available recently which may aid in reverse engineering for Ampere: <REDACTED>

[DualCoder]

@PAI5REECHO Please do not link to leaked copyright infringing material.

[PeterPorker3]

I hate to be the 4th guy to ask, but any news?

I noticed a lot of the discussion about looking into the a5000 drivers happened almost a year ago, is that more of a possibility now that some time has passed, and more software is available to examine? Furthermore, I would be happy to assist looking into it further as a summer project, but I'm not sure if I would be of much use since I have little experience with driver modification and development, and I only have access to a 3060.

[unrealbishop]

i guess this: https://developer.nvidia.com/blog/nvidia-releases-open-source-gpu-kernel-modules/ would count as good news?

just google "nvidia open source drivers" if you don't wanna click on links.

we just have to be patient until they fully make everything open source i guess.

[Santiblocks]

If anything, i think it is bad news, cause it means they probably have a way to restrict vgpu unlock at firmware level, as the failed attempts to make vgpu work have suggested

[Kamilake]

Can't 3090 work like the A40?
RTX A40 appears to support vGPU..

[poohzaza166]

5th guy to ask any updates?

[alex4401]

Can't 3090 work like the A40? RTX A40 appears to support vGPU..

The A40 is a data centre GPU with VGPU capability enabled. That doesn't mean any other Ampere GPU has it enabled, and it's probably locked within the on-board chip firmware.

[KrutavShah]

I think it’s best to close this issue as this specific GitHub repository is not likely to be updated any time soon. I have heard that other members of the community have been working on an Ampere solution but there does not appear to be much success. If there’s any updates regarding that, it’ll be on their repository, but don’t expect anything when it comes to Ampere.

[leticiatm]

I think it’s best to close this issue as this specific GitHub repository is not likely to be updated any time soon. I have heard that other members of the community have been working on an Ampere solution but there does not appear to be much success. If there’s any updates regarding that, it’ll be on their repository, but don’t expect anything when it comes to Ampere.

can you link those other repos?

[gentoorax]

I think it’s best to close this issue as this specific GitHub repository is not likely to be updated any time soon. I have heard that other members of the community have been working on an Ampere solution but there does not appear to be much success. If there’s any updates regarding that, it’ll be on their repository, but don’t expect anything when it comes to Ampere.

Can we have a link to the Ampere repository mentioned?

[gentoorax]

No news at this time.

Current status is unchanged: The guest driver crashes on startup due to a null-pointer dereference. It is unknown if this is due to a bug in the driver or if SR-IOV is required for the driver to function. AFAIK nobody is actively working on this at this time.

@DualCoder - now that the A5000 is around and has vGPU support, do you know if anyone tried spoofing the 3090 as a A5000 instead of an A40 to see if that has anymore success? I was going to give this a go when I get minute. I'm happy to try and test something. I basically got a 3090 for this purpose (now they're massively down in price) before I'd read people were having issues with a null reference pointer exception. Let me know if you think I'm wasting my time.

[delta-whiplash]

Hello any updates?

[seyk777]

still waiting

[jfrgagnon]

Would the 15.0 and 15.1 release for Ampere Architecture could be some good news for the 3070ti GA104 and more?

https://docs.nvidia.com/grid/latest/grid-vgpu-release-notes-red-hat-el-kvm/index.html#release-notes

[delta-whiplash]

Could someone with an RTX 3000 please try for us
and leave a comment of his experience here

[Alfatango12]

Any news?

[FrederikSchack]

I'm very curious too. I read somewhere that vbios in the Ampere architecture was encrypted, is this a roadblock?

[JustAnotherPU]

Any advancement on the project guys ?

[AkechiShiro]

Any update or any news to share ?

@FrederikSchack can you share the source about the encrypted vBIOS, it should be possible to dump it if you have the card using an external programmer maybe?

If I get an Ampere GPU, I'll try to investigate