Skip to content

0.4.0

Compare
Choose a tag to compare
@b4rtaz b4rtaz released this 09 May 17:38
· 137 commits to main since this release
e93d1e6
  • feat: support for any number of threads.
  • fix: support max kv cache length.
  • feat: splitting RoPE into all nodes.