Release v0.0.3: fix: fatal bugfix in batch decode operator (#177) · octoml/flashinfer · GitHub

v0.0.3
238563f
Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.

GPG key ID: B5690EEEBB952194

Verified
Learn about vigilant mode
Compare

Choose a tag to compare

Loading

View all tags

v0.0.3: fix: fatal bugfix in batch decode operator (#177)

v0.0.3
238563f
Compare

Choose a tag to compare

Loading

View all tags
Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.

GPG key ID: B5690EEEBB952194

Verified
Learn about vigilant mode

yzh119 tagged this 12 Mar 09:13

The `BatchDecodeWithPagedKVCacheWrapper` didn't run into the kernel.

Assets 2