Code

Optimized DeepSeek-v2 on Gaudi#1677

Code

Merged

regisss merged 16 commits intohuggingface:mainhuggingface/optimum-habana:mainfrom gyou2021:DeepSeek_V2gyou2021/optimum-habana:DeepSeek_V2Copy head branch name to clipboardJan 28, 2025

+1,175-221

Commits

Commits on Jan 6, 2025

• Optimized attention and MoE of deepseek_v2 on Gaudi

  gyou2021

  committed
  1903f43

  Copy full SHA for 1903f43

• Optimized cache

  gyou2021

  committed
  33c0930

  Copy full SHA for 33c0930

• enable training with sdpa

  

  ranzhejiang

  authored and

  gyou2021

  committed
  5b0bc2b

  Copy full SHA for 5b0bc2b

• add gaudi fused kernel config for deepseek_v2

  

  ranzhejiang

  authored and

  gyou2021

  committed
  1b53cf8

  Copy full SHA for 1b53cf8

• Added expert slice to support large scale DeepSeek-v2 models such as deepseek-v2-chat-0628

  gyou2021

  committed
  aaae320

  Copy full SHA for aaae320

Commits on Jan 8, 2025

• add fused kernel config support for run_clm.py

  ranzhejiang

  committed
  c982121

  Copy full SHA for c982121

• Fixed style errors

  gyou2021

  committed
  8b8e5c5

  Copy full SHA for 8b8e5c5

• Updated DeepSeek-V2 in README

  gyou2021

  committed
  cd79a76

  Copy full SHA for cd79a76

Commits on Jan 12, 2025

• remove some outdate statements

  ranzhejiang

  committed
  1e04748

  Copy full SHA for 1e04748

Commits on Jan 17, 2025

• Added DeepSeek_v2 to reuse_cache assert

  gyou2021

  committed
  146a9d3

  Copy full SHA for 146a9d3

• Added the training command of DeepSeek-V2-Lite.

  gyou2021

  committed
  71d54d8

  Copy full SHA for 71d54d8

Commits on Jan 28, 2025

• Added support for deepseek-v2 training

  gyou2021

  committed
  57a86b6

  Copy full SHA for 57a86b6

• Refactor the code.

  gyou2021

  committed
  8a4c1a8

  Copy full SHA for 8a4c1a8

• Fixed conflicts.

  gyou2021

  committed
  5e216f8

  Copy full SHA for 5e216f8

• Removed comments

  gyou2021

  committed
  02a5adc

  Copy full SHA for 02a5adc

• Fixed style.

  gyou2021

  committed
  62d6313

  Copy full SHA for 62d6313