GGUF models terrible performance with dual gpu setup? #508
Unanswered
trihardseven
asked this question in
Q&A
Replies: 1 comment
-
|
Probably normal. Multi gpu is not fast |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
So, I was testing GGUF Xwin 70b on two GPUS and I found the speed was incredibly slow, like worse than using one GPU and offseting to CPU instead. Is this normal behavior or is it an issue on my end?
Beta Was this translation helpful? Give feedback.
All reactions