Code

Add API for updating ZeRO gradients#6590

Code

Merged

tohtana merged 8 commits intomasterdeepspeedai/DeepSpeed:masterfrom olruwase/set_zero_opt_graddeepspeedai/DeepSpeed:olruwase/set_zero_opt_gradCopy head branch name to clipboardOct 14, 2024

+211-85

Commits

Commits on Sep 29, 2024

• Add API for updating ZeRO gradients

  tjruwase

  committed
  18ee6cf

  Copy full SHA for 18ee6cf

• Merge branch 'master' into olruwase/set_zero_opt_grad

  tjruwase

  authored
  6110f70

  Copy full SHA for 6110f70

• Update docs

  tjruwase

  committed
  c589284

  Copy full SHA for c589284

Commits on Sep 30, 2024

• Format fix

  tjruwase

  committed
  e88cad9

  Copy full SHA for e88cad9

Commits on Oct 7, 2024

• Update docs; Improve DS logging consistency

  tjruwase

  committed
  1fde1f3

  Copy full SHA for 1fde1f3

• Merge branch 'master' into olruwase/set_zero_opt_grad

  tjruwase

  authored
  55b558e

  Copy full SHA for 55b558e

• Merge branch 'master' into olruwase/set_zero_opt_grad

  tjruwase

  authored
  021dc0a

  Copy full SHA for 021dc0a

Commits on Oct 8, 2024

• Merge branch 'master' into olruwase/set_zero_opt_grad

  tjruwase

  authored
  5372ee6

  Copy full SHA for 5372ee6