Code

Add Inference Spec & CI#23

Code

Open

AlejandroEsquivel wants to merge 12 commits intomainguardrails-ai/toxic_language:mainfrom feat/ray-serveguardrails-ai/toxic_language:feat/ray-serveCopy head branch name to clipboard

+361

Commits

Commits on Aug 20, 2024

• Updated for sagemaker endpoints compatibility

  AlejandroEsquivel

  committed
  937a8eb

  Copy full SHA for 937a8eb

• minor fix

  AlejandroEsquivel

  committed
  db2fa50

  Copy full SHA for db2fa50

Commits on Aug 22, 2024

• added ci for publishing sagemaker images

  AlejandroEsquivel

  committed
  cac0a4d

  Copy full SHA for cac0a4d

Commits on Sep 10, 2024

• wip: structure to support ray serve

  AlejandroEsquivel

  committed
  c23eb12

  Copy full SHA for c23eb12

• Renamed app model to inference spec, moved request handler to inference spec class

  AlejandroEsquivel

  committed
  f208ad6

  Copy full SHA for f208ad6

• added github url in serve runtime env

  AlejandroEsquivel

  committed
  8a9a446

  Copy full SHA for 8a9a446

• updating ray actor options

  AlejandroEsquivel

  committed
  38ad66e

  Copy full SHA for 38ad66e

Commits on Sep 16, 2024

• removed ray serve code, added back original fastapi script for backwards compatibility with inference box

  AlejandroEsquivel

  committed
  20f343c

  Copy full SHA for 20f343c

Commits on Sep 17, 2024

• updating sagemaker setup to work with shared models_host package

  AlejandroEsquivel

  committed
  78bb858

  Copy full SHA for 78bb858

• added ci

  AlejandroEsquivel

  committed
  1636de7

  Copy full SHA for 1636de7

• removed unused import

  AlejandroEsquivel

  committed
  0797927

  Copy full SHA for 0797927

• added example

  AlejandroEsquivel

  committed
  07df86c

  Copy full SHA for 07df86c