Code

Piotrm api server#30

Code

Closed

piotrm-nvidia wants to merge 52 commits intomaintriton-inference-server/triton_distributed:mainfrom piotrm-api-servertriton-inference-server/triton_distributed:piotrm-api-serverCopy head branch name to clipboard

+4,197-118

Commits

Commits on Jan 15, 2025

• updated with skeleton / straw man structure

  nnshah1

  committed
  9a67e25

  Copy full SHA for 9a67e25

• updated

  nnshah1

  committed
  44304db

  Copy full SHA for 44304db

• updated

  nnshah1

  committed
  f4a1ef0

  Copy full SHA for f4a1ef0

• moving under operators

  nnshah1

  committed
  62b20c5

  Copy full SHA for 62b20c5

Commits on Jan 16, 2025

• updated skeleton

  nnshah1

  committed
  7dd83c1

  Copy full SHA for 7dd83c1

• Merge branch 'main' into nnshah1-hello-world

  nnshah1

  authored
  aafe096

  Copy full SHA for aafe096

• updated with minimal example - not yet tested

  nnshah1

  committed
  cad9d3f

  Copy full SHA for cad9d3f

• Merge branch 'nnshah1-hello-world' of https://github.com/triton-inference-server/triton-distributed into nnshah1-hello-world

  nnshah1

  committed
  41abd50

  Copy full SHA for 41abd50

• updated to use deployment

  nnshah1

  committed
  97c752d

  Copy full SHA for 97c752d

• updating with single_file separate from main

  nnshah1

  committed
  b0f3464

  Copy full SHA for b0f3464

• updating

  nnshah1

  committed
  991358b

  Copy full SHA for 991358b

• docs: Add descriptions for example and main folder

  piotrm-nvidia

  authored
  bd57e10

  Copy full SHA for bd57e10

• updating to add operator to operators folder for us in 'deploy'

  nnshah1

  committed
  1109f65

  Copy full SHA for 1109f65

• Merge branch 'nnshah1-hello-world' of https://github.com/triton-inference-server/triton-distributed into nnshah1-hello-world

  nnshah1

  committed
  d16811c

  Copy full SHA for d16811c

• updates to remove operator from deploy

  nnshah1

  committed
  88de51c

  Copy full SHA for 88de51c

• incremental updates

  nnshah1

  committed
  a7face5

  Copy full SHA for a7face5

• removing temporary files

  nnshah1

  committed
  c52b3ad

  Copy full SHA for c52b3ad

• putting more common handling into deployment

  nnshah1

  committed
  ff72717

  Copy full SHA for ff72717

• updating default for single file

  nnshah1

  committed
  3611828

  Copy full SHA for 3611828

• Merge branch 'main' into nnshah1-hello-world

  nnshah1

  committed
  a01fd7b

  Copy full SHA for a01fd7b

• updating with deploy app

  nnshah1

  committed
  958f5f8

  Copy full SHA for 958f5f8

• updated with signal handler for exit

  nnshah1

  committed
  c4e6fed

  Copy full SHA for c4e6fed

• adding parser

  nnshah1

  committed
  00aedbc

  Copy full SHA for 00aedbc

• removing gitkeep

  nnshah1

  committed
  c2dc190

  Copy full SHA for c2dc190

Commits on Jan 17, 2025

• adding in initial client - still testing

  nnshah1

  committed
  3a74bcb

  Copy full SHA for 3a74bcb

• updated with working client

  nnshah1

  committed
  e7bd20f

  Copy full SHA for e7bd20f

• updated to remove version

  nnshah1

  committed
  369259f

  Copy full SHA for 369259f

• removing version from tests

  nnshah1

  committed
  9f56b11

  Copy full SHA for 9f56b11

• adding basic exit code detection to help with sanity tests

  nnshah1

  committed
  dadd9f0

  Copy full SHA for dadd9f0

• adding sanity test

  nnshah1

  committed
  2da91d7

  Copy full SHA for 2da91d7

• delete unnecessary file

  nnshah1

  committed
  f2673f8

  Copy full SHA for f2673f8

• adding copyright

  nnshah1

  committed
  348b578

  Copy full SHA for 348b578

• removing unnecessary files

  nnshah1

  committed
  5748a15

  Copy full SHA for 5748a15

• Merge branch 'main' into nnshah1-hello-world

  nnshah1

  committed
  f62b18e

  Copy full SHA for f62b18e

• updates for static type checks

  nnshah1

  committed
  26fe1d8

  Copy full SHA for 26fe1d8

• adding sanity test to pre-merge until we have additional triggers enabled

  nnshah1

  committed
  9421700

  Copy full SHA for 9421700

• reduce number of requests for sanity test

  nnshah1

  committed
  7298502

  Copy full SHA for 7298502

• Merge branch 'main' into nnshah1-hello-world

  nnshah1

  committed
  aac2881

  Copy full SHA for aac2881

• removing version from RemoteOperator calls

  nnshah1

  committed
  444a82a

  Copy full SHA for 444a82a

• adding copyright

  nnshah1

  committed
  671ce6a

  Copy full SHA for 671ce6a

• updating copyright

  nnshah1

  committed
  2d0f1db

  Copy full SHA for 2d0f1db

• Add API server draft

  piotrm-nvidia

  committed
  8f2173c

  Copy full SHA for 8f2173c

• Add tests for API server

  piotrm-nvidia

  committed
  0b5b814

  Copy full SHA for 0b5b814

• Add more changes

  piotrm-nvidia

  committed
  45e2e46

  Copy full SHA for 45e2e46

Commits on Jan 21, 2025

• Add server thread

  piotrm-nvidia

  committed
  b10479e

  Copy full SHA for b10479e

• Adjust sleep to block server

  piotrm-nvidia

  committed
  fac9da6

  Copy full SHA for fac9da6

Commits on Jan 22, 2025

• Add README.md to API server

  piotrm-nvidia

  committed
  58a97e9

  Copy full SHA for 58a97e9

• Adjustr import for Worker config

  piotrm-nvidia

  committed
  32c50d5

  Copy full SHA for 32c50d5

• Wrapp connector logic with LLMEngine

  piotrm-nvidia

  committed
  f5ba2ce

  Copy full SHA for f5ba2ce

• Add parameters parsing

  piotrm-nvidia

  committed
  3a79d11

  Copy full SHA for 3a79d11

• Fix uvicorn harness in operator

  piotrm-nvidia

  committed
  9d7e8bd

  Copy full SHA for 9d7e8bd

• Shift FastAPI endpoint outside operator

  piotrm-nvidia

  committed
  48b6a83

  Copy full SHA for 48b6a83