Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
rlsu9 committed Dec 31, 2024
1 parent b2a75a5 commit e0234ea
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion fastvideo/models/mochi_hf/modeling_mochi.py
Original file line number Diff line number Diff line change
Expand Up @@ -489,7 +489,7 @@ def _create_rope(self, freqs: torch.Tensor,
with torch.autocast(freqs.device.type, enabled=False):
# Always run ROPE freqs computation in FP32
freqs = torch.einsum(
"nd,dhf->nhf",
"nd,dhf->nhf", # codespell:ignore
pos.to(torch.float32), # codespell:ignore
freqs.to(torch.float32))
freqs_cos = torch.cos(freqs)
Expand Down

0 comments on commit e0234ea

Please sign in to comment.