Skip to content

fix num_kv_heads sharding in autoTP for the new in-repo Falcon-40B#4654

Merged
loadams merged 3 commits intodeepspeedai:masterfrom dc3671:masterNov 10, 2023

Commits

Commits on Nov 8, 2023

Commits on Nov 10, 2023