Code

Multi model refactor#223

Code

Draft

TosinSeg wants to merge 15 commits intomicrosoft:mainmicrosoft/DeepSpeed-MII:mainfrom TosinSeg:multi-model-refactorTosinSeg/DeepSpeed-MII:multi-model-refactorCopy head branch name to clipboard

+1,213-1,253

Commits

Commits on Aug 4, 2023

• refactoring configs

  mrwyattii

  committed
  5c29257

  Copy full SHA for 5c29257

Commits on Aug 8, 2023

• further refactoring

  mrwyattii

  committed
  206fc2c

  Copy full SHA for 206fc2c

• fix errors, get things running

  mrwyattii

  committed
  926795d

  Copy full SHA for 926795d

• formatting and flake fixes

  mrwyattii

  committed
  0b04ed2

  Copy full SHA for 0b04ed2

• remove formatting changes

  mrwyattii

  committed
  e5aea20

  Copy full SHA for e5aea20

• get tests working again

  mrwyattii

  committed
  b0f3f65

  Copy full SHA for b0f3f65

• fix non-persistent deployment error

  mrwyattii

  committed
  7e206ef

  Copy full SHA for 7e206ef

• fix restful test

  mrwyattii

  committed
  018215e

  Copy full SHA for 018215e

Commits on Aug 9, 2023

• fix zero config test failures

  mrwyattii

  committed
  c77c78d

  Copy full SHA for c77c78d

• attempt to fix hf_auth error

  mrwyattii

  committed
  3f50926

  Copy full SHA for 3f50926

• Allocating multiple processes

  

  Tosin Segun

  committed
  4f3b63e

  Copy full SHA for 4f3b63e

• Support for multiple deployments in deploy() API

  

  Tosin Segun

  committed
  9487437

  Copy full SHA for 9487437

Commits on Aug 11, 2023

• Load balancer support for multiple models

  

  Tosin Segun

  committed
  511fd16

  Copy full SHA for 511fd16

• Refacoring and some formatting

  

  Tosin Segun

  committed
  04f7989

  Copy full SHA for 04f7989

Commits on Aug 12, 2023

• Fixing deserialization

  

  Tosin Segun

  committed
  de998bf

  Copy full SHA for de998bf