You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I made minor some adjustments to the code to try and quantize Minitron-4B-Base (nemotron architecture has no gate_proj in the MLP) but the resulting model is completely unusable. I think more work has to go into it being supported but I do not know how to do that,
The text was updated successfully, but these errors were encountered:
I made minor some adjustments to the code to try and quantize Minitron-4B-Base (nemotron architecture has no gate_proj in the MLP) but the resulting model is completely unusable. I think more work has to go into it being supported but I do not know how to do that,
The text was updated successfully, but these errors were encountered: