当前的QNN后端是否能够支持模型推理？ #3
Answered
by
chraac
FranzKafkaYu
asked this question in
Q&A
-
|
@chraac Hi，作者你好。想问一下当前仓库的代码是否已经支持模型推理，还是说只是实现了部分算子？我可以基于当前版本的QNN后端部署大模型吗 |
Beta Was this translation helpful? Give feedback.
Answered by
chraac
Sep 19, 2024
Replies: 1 comment
-
|
你好，现在matmul的这个算子还有问题，然后还有一个分支在重构中，具体可以看看这个PR(#2 )里面的说明，对代码有相关疑问也可以在里面讨论 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
chraac
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
你好，现在matmul的这个算子还有问题，然后还有一个分支在重构中，具体可以看看这个PR(#2 )里面的说明，对代码有相关疑问也可以在里面讨论