Code

Support batching#5

Code

Merged

dgbaenar merged 2 commits intomainfastenhealth/fasten-answers-ai:mainfrom speed_batchingfastenhealth/fasten-answers-ai:speed_batchingCopy head branch name to clipboardSep 4, 2024

+99-51

Commits

Commits on Sep 2, 2024

• Support batching

  mats-claassen

  committed
  3b51192

  Copy full SHA for 3b51192

Commits on Sep 4, 2024

• Add batched version to LLM client in app

  mats-claassen

  committed
  2c47611

  Copy full SHA for 2c47611