rpc : track allocated buffers (#7411) · chraac/llama.cpp@db10f01 · GitHub

Commit

rpc : track allocated buffers (ggml-org#7411)

Browse files

* rpc : track allocated buffers

ref: ggml-org#7407

* rpc : pack rpc_tensor tightly

Loading branch information

rgerganov authored May 20, 2024

1 parent 3bc10cb commit db10f01