You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Backward pass for MLP training for MNIST with cross-entropy loss fails with error: BinaryOpType cannot be mapped to BcastOpMath
This is due to metal issue tenstorrent/tt-metal#15216 and, on a more general side, issue that binary eltwise ops support broadcasting only for second input, which fails for non-commutative ops (as explained in tenstorrent/tt-metal#14852).
Concretely, in the case of this backward pass, broadcast in division is needed for the first input (from 1x1xf32 to 4x1xf32) as may be seen below.
Backward pass for MLP training for MNIST with cross-entropy loss fails with error:
BinaryOpType cannot be mapped to BcastOpMath
This is due to metal issue tenstorrent/tt-metal#15216 and, on a more general side, issue that binary eltwise ops support broadcasting only for second input, which fails for non-commutative ops (as explained in tenstorrent/tt-metal#14852).
Concretely, in the case of this backward pass, broadcast in division is needed for the first input (from 1x1xf32 to 4x1xf32) as may be seen below.
Cases like this should be covered in https://github.com/tenstorrent/tt-xla/blob/main/tests/jax/ops/test_divide.py, as well as in tests for other binary eltwise non-commutative ops.
The text was updated successfully, but these errors were encountered: