Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TVM cleanup #1267

Merged
merged 7 commits into from
Feb 27, 2025
Merged

TVM cleanup #1267

merged 7 commits into from
Feb 27, 2025

Conversation

vkovinicTT
Copy link
Member

@vkovinicTT vkovinicTT commented Feb 21, 2025

Result

Compiler logic moved from tvm to forge-fe.

Comprehensive overview

This is only the first cleaning pass where core compiler logic was transfered from tvm to the forge-fe. For comprehensive overview, TVM will be cleaned in a few stages.

Coresponding PR in tvm.

Moved following files to forge-fe repo:

  • python/tvm/contrib/forge_compile.py
  • python/tvm/contrib/forge_utils.py
  • python/tvm/relay/op/contrib/forge/__init__.py
  • python/tvm/relay/op/contrib/forge/forge.py
  • python/tvm/relay/op/contrib/forge/relay_passes.py
  • python/tvm/relay/op/contrib/forge/reportify.py
  • python/tvm/relay/op/contrib/forge/utils.py.

Coresponding structure:

forge/forge
│
├── tvm_calls
│   ├── forge_utils.py
│   ├── forge_compile.py
│   └── relay
│       ├── op
│       │   ├── forge_passes.py
│       │   ├── forge.py
│       │   ├── relay_passes.py
│       │   ├── reportify.py
│       │   └── utils.py

**Aditional notes:

These files were just moved to our repo so once uplift is done, we should probably refactor this code into more sensible modules.

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests601 ran480 passed121 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests601 ran480 passed121 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests660 ran520 passed140 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests660 ran520 passed140 skipped0 failed
TestResult
No test annotations available

@vkovinicTT vkovinicTT force-pushed the vkovinic/tvm_cleanup branch 2 times, most recently from c3ec87c to a1e1ffb Compare February 25, 2025 13:40
@vkovinicTT vkovinicTT marked this pull request as ready for review February 25, 2025 14:19
Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests611 ran412 passed129 skipped70 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_less[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_less[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_less[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_greater[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_greater[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_greater[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_greater[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_not_equal[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_not_equal[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_not_equal[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_not_equal[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_equal[shape0]❌ failure
test_eltwise_binary.test_equal[shape2]❌ failure
test_eltwise_binary.test_equal[shape4]❌ failure
test_eltwise_binary.test_equal[shape6]❌ failure
test_eltwise_binary.test_equal[shape8]❌ failure
test_eltwise_binary.test_equal[shape11]❌ failure
test_eltwise_binary.test_equal[shape13]❌ failure
test_eltwise_binary.test_equal[shape15]❌ failure
test_eltwise_binary.test_equal[shape17]❌ failure
test_eltwise_binary.test_equal[shape19]❌ failure
test_eltwise_binary.test_equal[shape20]❌ failure
test_eltwise_binary.test_equal[shape22]❌ failure
test_eltwise_binary.test_greater_equal[dims1]❌ failure
test_eltwise_unary.test_nan_to_num[shape1-dtype1]❌ failure
test_eltwise_unary.test_nan_to_num[shape7-dtype7]❌ failure
test_advanced_indexing.test_index_select[input_dim_index0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index0]❌ failure
test_advanced_slicing.test_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index4]❌ failure
test_basic_slicing.test_multidimensional_slicing[ellipsis_first_dim]❌ failure
test_tm.test_index[shape0-1-21]❌ failure
test_tm.test_index[shape2-3-30]❌ failure
test_tm.test_index[shape4--2--103]❌ failure
test_tm.test_index[shape6-2--2]❌ failure
test_tm.test_index[shape8-0-2]❌ failure
test_tm.test_index[shape10-2--5]❌ failure
test_tm.test_index[shape12--2--20]❌ failure
test_tm.test_reshape_pytorch❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_maxpool2d[act_shape1]❌ failure
test_ops_tf.test_maxpool2d[act_shape4]❌ failure
test_ops_tf.test_maxpool2d[act_shape5]❌ failure
test_ops_tf.test_maxpool2d[act_shape6]❌ failure
test_ops_tf.test_maxpool2d[act_shape7]❌ failure
test_ops_tf.test_maxpool2d[act_shape8]❌ failure
test_ops_tf.test_maxpool2d[act_shape9]❌ failure
test_ops_tf.test_maxpool2d[act_shape10]❌ failure
test_ops_tf.test_maxpool2d[act_shape11]❌ failure
test_ops_tf.test_maxpool2d[act_shape12]❌ failure
test_ops_tf.test_maxpool2d[act_shape13]❌ failure
test_ops_tf.test_maxpool2d[act_shape19]❌ failure
test_ops_tf.test_maxpool2d[act_shape22]❌ failure
test_ops_tf.test_maxpool2d[act_shape25]❌ failure
test_vilt.test_vilt_question_answering_hf_pytorch[dandelin/vilt-b32-finetuned-vqa]❌ failure
test_dla.test_dla_pytorch[dla34]❌ failure
test_efficientnet.test_efficientnet_timm[efficientnet_b0]❌ failure
test_ghostnet.test_ghostnet_timm[ghostnet_100]❌ failure
test_mobilenet_v3.test_mobilenetv3_basic[mobilenet_v3_large]❌ failure
test_llama_self_attn.test_llama_self_attn[openlm-research/open_llama_3b]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests670 ran465 passed134 skipped71 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_less[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_less[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_less[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_greater[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_greater[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_greater[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_greater[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_not_equal[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_not_equal[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_not_equal[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_not_equal[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_equal[shape1]❌ failure
test_eltwise_binary.test_equal[shape3]❌ failure
test_eltwise_binary.test_equal[shape5]❌ failure
test_eltwise_binary.test_equal[shape7]❌ failure
test_eltwise_binary.test_equal[shape9]❌ failure
test_eltwise_binary.test_equal[shape10]❌ failure
test_eltwise_binary.test_equal[shape12]❌ failure
test_eltwise_binary.test_equal[shape14]❌ failure
test_eltwise_binary.test_equal[shape16]❌ failure
test_eltwise_binary.test_equal[shape18]❌ failure
test_eltwise_binary.test_equal[shape21]❌ failure
test_eltwise_binary.test_equal[shape23]❌ failure
test_eltwise_binary.test_greater_equal[dims0]❌ failure
test_eltwise_binary.test_greater_equal[dims2]❌ failure
test_eltwise_unary.test_nan_to_num[shape4-dtype4]❌ failure
test_eltwise_unary.test_nan_to_num[shape6-dtype6]❌ failure
test_advanced_indexing.test_index_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index3]❌ failure
test_advanced_slicing.test_select[input_dim_index5]❌ failure
test_tm.test_index[shape1-2--403]❌ failure
test_tm.test_index[shape3--3--21]❌ failure
test_tm.test_index[shape5--1-36]❌ failure
test_tm.test_index[shape7--2--1]❌ failure
test_tm.test_index[shape9-1-50]❌ failure
test_tm.test_index[shape11--1-15]❌ failure
test_tm.test_index[shape13--3--12]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_dual_conv2d❌ failure
test_ops_tf.test_maxpool2d[act_shape0]❌ failure
test_ops_tf.test_maxpool2d[act_shape2]❌ failure
test_ops_tf.test_maxpool2d[act_shape3]❌ failure
test_ops_tf.test_maxpool2d[act_shape14]❌ failure
test_ops_tf.test_maxpool2d[act_shape15]❌ failure
test_ops_tf.test_maxpool2d[act_shape16]❌ failure
test_ops_tf.test_maxpool2d[act_shape17]❌ failure
test_ops_tf.test_maxpool2d[act_shape18]❌ failure
test_ops_tf.test_maxpool2d[act_shape20]❌ failure
test_ops_tf.test_maxpool2d[act_shape21]❌ failure
test_ops_tf.test_maxpool2d[act_shape23]❌ failure
test_ops_tf.test_maxpool2d[act_shape24]❌ failure
test_ops_tf.test_maxpool2d[act_shape26]❌ failure
test_features.test_input_order[a_shape0-b_shape0-c_shape0]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v1]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v2]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v1]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v2]❌ failure
test_bert.test_bert_masked_lm_pytorch[bert-base-uncased]❌ failure
test_dpr.test_dpr_context_encoder_pytorch[facebook/dpr-ctx_encoder-single-nq-base]❌ failure
test_llama_self_attn.test_llama_self_attn[meta-llama/Llama-3.2-1B]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests611 ran412 passed129 skipped70 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_less[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_less[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_less[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_greater[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_greater[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_greater[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_greater[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_not_equal[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_not_equal[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_not_equal[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_not_equal[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_equal[shape0]❌ failure
test_eltwise_binary.test_equal[shape2]❌ failure
test_eltwise_binary.test_equal[shape4]❌ failure
test_eltwise_binary.test_equal[shape6]❌ failure
test_eltwise_binary.test_equal[shape8]❌ failure
test_eltwise_binary.test_equal[shape11]❌ failure
test_eltwise_binary.test_equal[shape13]❌ failure
test_eltwise_binary.test_equal[shape15]❌ failure
test_eltwise_binary.test_equal[shape17]❌ failure
test_eltwise_binary.test_equal[shape19]❌ failure
test_eltwise_binary.test_equal[shape20]❌ failure
test_eltwise_binary.test_equal[shape22]❌ failure
test_eltwise_binary.test_greater_equal[dims1]❌ failure
test_eltwise_unary.test_nan_to_num[shape1-dtype1]❌ failure
test_eltwise_unary.test_nan_to_num[shape7-dtype7]❌ failure
test_advanced_indexing.test_index_select[input_dim_index0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index0]❌ failure
test_advanced_slicing.test_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index4]❌ failure
test_basic_slicing.test_multidimensional_slicing[ellipsis_first_dim]❌ failure
test_tm.test_index[shape0-1-21]❌ failure
test_tm.test_index[shape2-3-30]❌ failure
test_tm.test_index[shape4--2--103]❌ failure
test_tm.test_index[shape6-2--2]❌ failure
test_tm.test_index[shape8-0-2]❌ failure
test_tm.test_index[shape10-2--5]❌ failure
test_tm.test_index[shape12--2--20]❌ failure
test_tm.test_reshape_pytorch❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_maxpool2d[act_shape1]❌ failure
test_ops_tf.test_maxpool2d[act_shape4]❌ failure
test_ops_tf.test_maxpool2d[act_shape5]❌ failure
test_ops_tf.test_maxpool2d[act_shape6]❌ failure
test_ops_tf.test_maxpool2d[act_shape7]❌ failure
test_ops_tf.test_maxpool2d[act_shape8]❌ failure
test_ops_tf.test_maxpool2d[act_shape9]❌ failure
test_ops_tf.test_maxpool2d[act_shape10]❌ failure
test_ops_tf.test_maxpool2d[act_shape11]❌ failure
test_ops_tf.test_maxpool2d[act_shape12]❌ failure
test_ops_tf.test_maxpool2d[act_shape13]❌ failure
test_ops_tf.test_maxpool2d[act_shape19]❌ failure
test_ops_tf.test_maxpool2d[act_shape22]❌ failure
test_ops_tf.test_maxpool2d[act_shape25]❌ failure
test_vilt.test_vilt_question_answering_hf_pytorch[dandelin/vilt-b32-finetuned-vqa]❌ failure
test_dla.test_dla_pytorch[dla34]❌ failure
test_efficientnet.test_efficientnet_timm[efficientnet_b0]❌ failure
test_ghostnet.test_ghostnet_timm[ghostnet_100]❌ failure
test_mobilenet_v3.test_mobilenetv3_basic[mobilenet_v3_large]❌ failure
test_llama_self_attn.test_llama_self_attn[openlm-research/open_llama_3b]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests611 ran412 passed129 skipped70 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_less[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_less[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_less[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_greater[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_greater[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_greater[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_greater[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_not_equal[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_not_equal[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_not_equal[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_not_equal[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_equal[shape0]❌ failure
test_eltwise_binary.test_equal[shape2]❌ failure
test_eltwise_binary.test_equal[shape4]❌ failure
test_eltwise_binary.test_equal[shape6]❌ failure
test_eltwise_binary.test_equal[shape8]❌ failure
test_eltwise_binary.test_equal[shape11]❌ failure
test_eltwise_binary.test_equal[shape13]❌ failure
test_eltwise_binary.test_equal[shape15]❌ failure
test_eltwise_binary.test_equal[shape17]❌ failure
test_eltwise_binary.test_equal[shape19]❌ failure
test_eltwise_binary.test_equal[shape20]❌ failure
test_eltwise_binary.test_equal[shape22]❌ failure
test_eltwise_binary.test_greater_equal[dims1]❌ failure
test_eltwise_unary.test_nan_to_num[shape1-dtype1]❌ failure
test_eltwise_unary.test_nan_to_num[shape7-dtype7]❌ failure
test_advanced_indexing.test_index_select[input_dim_index0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index0]❌ failure
test_advanced_slicing.test_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index4]❌ failure
test_basic_slicing.test_multidimensional_slicing[ellipsis_first_dim]❌ failure
test_tm.test_index[shape0-1-21]❌ failure
test_tm.test_index[shape2-3-30]❌ failure
test_tm.test_index[shape4--2--103]❌ failure
test_tm.test_index[shape6-2--2]❌ failure
test_tm.test_index[shape8-0-2]❌ failure
test_tm.test_index[shape10-2--5]❌ failure
test_tm.test_index[shape12--2--20]❌ failure
test_tm.test_reshape_pytorch❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_maxpool2d[act_shape1]❌ failure
test_ops_tf.test_maxpool2d[act_shape4]❌ failure
test_ops_tf.test_maxpool2d[act_shape5]❌ failure
test_ops_tf.test_maxpool2d[act_shape6]❌ failure
test_ops_tf.test_maxpool2d[act_shape7]❌ failure
test_ops_tf.test_maxpool2d[act_shape8]❌ failure
test_ops_tf.test_maxpool2d[act_shape9]❌ failure
test_ops_tf.test_maxpool2d[act_shape10]❌ failure
test_ops_tf.test_maxpool2d[act_shape11]❌ failure
test_ops_tf.test_maxpool2d[act_shape12]❌ failure
test_ops_tf.test_maxpool2d[act_shape13]❌ failure
test_ops_tf.test_maxpool2d[act_shape19]❌ failure
test_ops_tf.test_maxpool2d[act_shape22]❌ failure
test_ops_tf.test_maxpool2d[act_shape25]❌ failure
test_vilt.test_vilt_question_answering_hf_pytorch[dandelin/vilt-b32-finetuned-vqa]❌ failure
test_dla.test_dla_pytorch[dla34]❌ failure
test_efficientnet.test_efficientnet_timm[efficientnet_b0]❌ failure
test_ghostnet.test_ghostnet_timm[ghostnet_100]❌ failure
test_mobilenet_v3.test_mobilenetv3_basic[mobilenet_v3_large]❌ failure
test_llama_self_attn.test_llama_self_attn[openlm-research/open_llama_3b]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests670 ran465 passed134 skipped71 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_less[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_less[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_less[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_greater[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_greater[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_greater[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_greater[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_not_equal[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_not_equal[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_not_equal[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_not_equal[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_equal[shape1]❌ failure
test_eltwise_binary.test_equal[shape3]❌ failure
test_eltwise_binary.test_equal[shape5]❌ failure
test_eltwise_binary.test_equal[shape7]❌ failure
test_eltwise_binary.test_equal[shape9]❌ failure
test_eltwise_binary.test_equal[shape10]❌ failure
test_eltwise_binary.test_equal[shape12]❌ failure
test_eltwise_binary.test_equal[shape14]❌ failure
test_eltwise_binary.test_equal[shape16]❌ failure
test_eltwise_binary.test_equal[shape18]❌ failure
test_eltwise_binary.test_equal[shape21]❌ failure
test_eltwise_binary.test_equal[shape23]❌ failure
test_eltwise_binary.test_greater_equal[dims0]❌ failure
test_eltwise_binary.test_greater_equal[dims2]❌ failure
test_eltwise_unary.test_nan_to_num[shape4-dtype4]❌ failure
test_eltwise_unary.test_nan_to_num[shape6-dtype6]❌ failure
test_advanced_indexing.test_index_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index3]❌ failure
test_advanced_slicing.test_select[input_dim_index5]❌ failure
test_tm.test_index[shape1-2--403]❌ failure
test_tm.test_index[shape3--3--21]❌ failure
test_tm.test_index[shape5--1-36]❌ failure
test_tm.test_index[shape7--2--1]❌ failure
test_tm.test_index[shape9-1-50]❌ failure
test_tm.test_index[shape11--1-15]❌ failure
test_tm.test_index[shape13--3--12]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_dual_conv2d❌ failure
test_ops_tf.test_maxpool2d[act_shape0]❌ failure
test_ops_tf.test_maxpool2d[act_shape2]❌ failure
test_ops_tf.test_maxpool2d[act_shape3]❌ failure
test_ops_tf.test_maxpool2d[act_shape14]❌ failure
test_ops_tf.test_maxpool2d[act_shape15]❌ failure
test_ops_tf.test_maxpool2d[act_shape16]❌ failure
test_ops_tf.test_maxpool2d[act_shape17]❌ failure
test_ops_tf.test_maxpool2d[act_shape18]❌ failure
test_ops_tf.test_maxpool2d[act_shape20]❌ failure
test_ops_tf.test_maxpool2d[act_shape21]❌ failure
test_ops_tf.test_maxpool2d[act_shape23]❌ failure
test_ops_tf.test_maxpool2d[act_shape24]❌ failure
test_ops_tf.test_maxpool2d[act_shape26]❌ failure
test_features.test_input_order[a_shape0-b_shape0-c_shape0]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v1]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v2]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v1]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v2]❌ failure
test_bert.test_bert_masked_lm_pytorch[bert-base-uncased]❌ failure
test_dpr.test_dpr_context_encoder_pytorch[facebook/dpr-ctx_encoder-single-nq-base]❌ failure
test_llama_self_attn.test_llama_self_attn[meta-llama/Llama-3.2-1B]❌ failure

1 similar comment
Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests670 ran465 passed134 skipped71 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_less[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_less[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_less[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_greater[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_greater[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_greater[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_greater[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_not_equal[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_not_equal[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_not_equal[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_not_equal[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_equal[shape1]❌ failure
test_eltwise_binary.test_equal[shape3]❌ failure
test_eltwise_binary.test_equal[shape5]❌ failure
test_eltwise_binary.test_equal[shape7]❌ failure
test_eltwise_binary.test_equal[shape9]❌ failure
test_eltwise_binary.test_equal[shape10]❌ failure
test_eltwise_binary.test_equal[shape12]❌ failure
test_eltwise_binary.test_equal[shape14]❌ failure
test_eltwise_binary.test_equal[shape16]❌ failure
test_eltwise_binary.test_equal[shape18]❌ failure
test_eltwise_binary.test_equal[shape21]❌ failure
test_eltwise_binary.test_equal[shape23]❌ failure
test_eltwise_binary.test_greater_equal[dims0]❌ failure
test_eltwise_binary.test_greater_equal[dims2]❌ failure
test_eltwise_unary.test_nan_to_num[shape4-dtype4]❌ failure
test_eltwise_unary.test_nan_to_num[shape6-dtype6]❌ failure
test_advanced_indexing.test_index_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index3]❌ failure
test_advanced_slicing.test_select[input_dim_index5]❌ failure
test_tm.test_index[shape1-2--403]❌ failure
test_tm.test_index[shape3--3--21]❌ failure
test_tm.test_index[shape5--1-36]❌ failure
test_tm.test_index[shape7--2--1]❌ failure
test_tm.test_index[shape9-1-50]❌ failure
test_tm.test_index[shape11--1-15]❌ failure
test_tm.test_index[shape13--3--12]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_dual_conv2d❌ failure
test_ops_tf.test_maxpool2d[act_shape0]❌ failure
test_ops_tf.test_maxpool2d[act_shape2]❌ failure
test_ops_tf.test_maxpool2d[act_shape3]❌ failure
test_ops_tf.test_maxpool2d[act_shape14]❌ failure
test_ops_tf.test_maxpool2d[act_shape15]❌ failure
test_ops_tf.test_maxpool2d[act_shape16]❌ failure
test_ops_tf.test_maxpool2d[act_shape17]❌ failure
test_ops_tf.test_maxpool2d[act_shape18]❌ failure
test_ops_tf.test_maxpool2d[act_shape20]❌ failure
test_ops_tf.test_maxpool2d[act_shape21]❌ failure
test_ops_tf.test_maxpool2d[act_shape23]❌ failure
test_ops_tf.test_maxpool2d[act_shape24]❌ failure
test_ops_tf.test_maxpool2d[act_shape26]❌ failure
test_features.test_input_order[a_shape0-b_shape0-c_shape0]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v1]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v2]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v1]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v2]❌ failure
test_bert.test_bert_masked_lm_pytorch[bert-base-uncased]❌ failure
test_dpr.test_dpr_context_encoder_pytorch[facebook/dpr-ctx_encoder-single-nq-base]❌ failure
test_llama_self_attn.test_llama_self_attn[meta-llama/Llama-3.2-1B]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests611 ran412 passed129 skipped70 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_less[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_less[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_less[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_greater[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_greater[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_greater[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_greater[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_not_equal[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_not_equal[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_not_equal[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_not_equal[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_equal[shape0]❌ failure
test_eltwise_binary.test_equal[shape2]❌ failure
test_eltwise_binary.test_equal[shape4]❌ failure
test_eltwise_binary.test_equal[shape6]❌ failure
test_eltwise_binary.test_equal[shape8]❌ failure
test_eltwise_binary.test_equal[shape11]❌ failure
test_eltwise_binary.test_equal[shape13]❌ failure
test_eltwise_binary.test_equal[shape15]❌ failure
test_eltwise_binary.test_equal[shape17]❌ failure
test_eltwise_binary.test_equal[shape19]❌ failure
test_eltwise_binary.test_equal[shape20]❌ failure
test_eltwise_binary.test_equal[shape22]❌ failure
test_eltwise_binary.test_greater_equal[dims1]❌ failure
test_eltwise_unary.test_nan_to_num[shape1-dtype1]❌ failure
test_eltwise_unary.test_nan_to_num[shape7-dtype7]❌ failure
test_advanced_indexing.test_index_select[input_dim_index0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index0]❌ failure
test_advanced_slicing.test_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index4]❌ failure
test_basic_slicing.test_multidimensional_slicing[ellipsis_first_dim]❌ failure
test_tm.test_index[shape0-1-21]❌ failure
test_tm.test_index[shape2-3-30]❌ failure
test_tm.test_index[shape4--2--103]❌ failure
test_tm.test_index[shape6-2--2]❌ failure
test_tm.test_index[shape8-0-2]❌ failure
test_tm.test_index[shape10-2--5]❌ failure
test_tm.test_index[shape12--2--20]❌ failure
test_tm.test_reshape_pytorch❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_maxpool2d[act_shape1]❌ failure
test_ops_tf.test_maxpool2d[act_shape4]❌ failure
test_ops_tf.test_maxpool2d[act_shape5]❌ failure
test_ops_tf.test_maxpool2d[act_shape6]❌ failure
test_ops_tf.test_maxpool2d[act_shape7]❌ failure
test_ops_tf.test_maxpool2d[act_shape8]❌ failure
test_ops_tf.test_maxpool2d[act_shape9]❌ failure
test_ops_tf.test_maxpool2d[act_shape10]❌ failure
test_ops_tf.test_maxpool2d[act_shape11]❌ failure
test_ops_tf.test_maxpool2d[act_shape12]❌ failure
test_ops_tf.test_maxpool2d[act_shape13]❌ failure
test_ops_tf.test_maxpool2d[act_shape19]❌ failure
test_ops_tf.test_maxpool2d[act_shape22]❌ failure
test_ops_tf.test_maxpool2d[act_shape25]❌ failure
test_vilt.test_vilt_question_answering_hf_pytorch[dandelin/vilt-b32-finetuned-vqa]❌ failure
test_dla.test_dla_pytorch[dla34]❌ failure
test_efficientnet.test_efficientnet_timm[efficientnet_b0]❌ failure
test_ghostnet.test_ghostnet_timm[ghostnet_100]❌ failure
test_mobilenet_v3.test_mobilenetv3_basic[mobilenet_v3_large]❌ failure
test_llama_self_attn.test_llama_self_attn[openlm-research/open_llama_3b]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests613 ran52 passed132 skipped429 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_less[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_less[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_less[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_greater[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_greater[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_greater[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_greater[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_not_equal[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_not_equal[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_not_equal[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_not_equal[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_equal[shape1]❌ failure
test_eltwise_binary.test_equal[shape3]❌ failure
test_eltwise_binary.test_equal[shape5]❌ failure
test_eltwise_binary.test_equal[shape7]❌ failure
test_eltwise_binary.test_equal[shape9]❌ failure
test_eltwise_binary.test_equal[shape10]❌ failure
test_eltwise_binary.test_equal[shape12]❌ failure
test_eltwise_binary.test_equal[shape14]❌ failure
test_eltwise_binary.test_equal[shape16]❌ failure
test_eltwise_binary.test_equal[shape18]❌ failure
test_eltwise_binary.test_equal[shape21]❌ failure
test_eltwise_binary.test_equal[shape23]❌ failure
test_eltwise_binary.test_greater_equal[dims0]❌ failure
test_eltwise_binary.test_greater_equal[dims2]❌ failure
test_eltwise_binary.test_subtract❌ failure
test_eltwise_binary.test_multiply[shape1]❌ failure
test_eltwise_nary.test_concat[1]❌ failure
test_eltwise_nary.test_concat[3]❌ failure
test_eltwise_nary.test_concat[-2]❌ failure
test_eltwise_nary.test_concat[-4]❌ failure
test_eltwise_unary.test_nan_to_num[shape1-dtype1]❌ failure
test_eltwise_unary.test_nan_to_num[shape7-dtype7]❌ failure
test_eltwise_unary.test_power[shape1]❌ failure
test_eltwise_unary.test_power[shape3]❌ failure
test_eltwise_unary.test_power[shape5]❌ failure
test_eltwise_unary.test_power[shape7]❌ failure
test_eltwise_unary.test_power[shape9]❌ failure
test_eltwise_unary.test_cosine[shape0]❌ failure
test_eltwise_unary.test_gelu[shape0]❌ failure
test_eltwise_unary.test_clip[shape0-0-1]❌ failure
test_eltwise_unary.test_clip[shape2--0.5-0.5]❌ failure
test_eltwise_unary.test_clip[shape4--3.0--1.0]❌ failure
test_eltwise_unary.test_clip[shape6-1.0--1.0]❌ failure
test_eltwise_unary.test_clip[shape8--0.2-0.2]❌ failure
test_eltwise_unary.test_clip[shape10-0.0-2.0]❌ failure
test_eltwise_unary.test_cumsum[shape1-1]❌ failure
test_eltwise_unary.test_exp[shape1]❌ failure
test_eltwise_unary.test_exp[shape3]❌ failure
test_eltwise_unary.test_exp[shape5]❌ failure
test_eltwise_unary.test_log[shape4]❌ failure
test_eltwise_unary.test_log[shape6]❌ failure
test_eltwise_unary.test_log[shape8]❌ failure
test_eltwise_unary.test_log[shape10]❌ failure
test_eltwise_unary.test_log[14]❌ failure
test_eltwise_unary.test_log[shape13]❌ failure
test_eltwise_unary.test_log[56]❌ failure
test_eltwise_unary.test_log[shape16]❌ failure
test_eltwise_unary.test_log[shape18]❌ failure
test_eltwise_unary.test_log[shape20]❌ failure
test_eltwise_unary.test_log[shape22]❌ failure
test_eltwise_unary.test_log[7]❌ failure
test_eltwise_unary.test_relu❌ failure
test_eltwise_unary.test_sqrt[7-41]❌ failure
test_eltwise_unary.test_sqrt[32-41]❌ failure
test_eltwise_unary.test_sqrt[41-7]❌ failure
test_eltwise_unary.test_sqrt[41-32]❌ failure
test_eltwise_unary.test_reciprocal[shape0]❌ failure
test_eltwise_unary.test_reciprocal[shape2]❌ failure
test_eltwise_unary.test_reciprocal[shape4]❌ failure
test_eltwise_unary.test_reciprocal[shape6]❌ failure
test_eltwise_unary.test_sigmoid[shape1]❌ failure
test_eltwise_unary.test_sigmoid[shape3]❌ failure
test_eltwise_unary.test_sigmoid[shape5]❌ failure
test_eltwise_unary.test_sigmoid[shape7]❌ failure
test_eltwise_unary.test_tanh[input_shape0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index1]❌ failure
test_advanced_masking.test_masked_fill[1d_masked_fill]❌ failure
test_advanced_slicing.test_select[input_dim_index0]❌ failure
test_advanced_slicing.test_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index4]❌ failure
test_advanced_slicing.test_split[input_tensor_sizes_dim0]❌ failure
test_advanced_slicing.test_split[input_tensor_sizes_dim2]❌ failure
test_advanced_slicing.test_chunk[input_tensor_chunks_dim1]❌ failure
test_advanced_slicing.test_narrow[narrow_dim_1]❌ failure
test_advanced_slicing.test_narrow[narrow_single_element_dim_0]❌ failure
test_basic_slicing.test_slicing[slice_with_step]❌ failure
test_basic_slicing.test_slicing[first_five_elements]❌ failure
test_basic_slicing.test_slicing[all_but_last]❌ failure
test_basic_slicing.test_multidimensional_slicing[slicing_across_multiple_dims]❌ failure
test_basic_slicing.test_multidimensional_slicing[rows_and_columns_subrange]❌ failure
test_basic_slicing.test_multidimensional_slicing[ellipsis_first_dim]❌ failure
test_basic_slicing.test_multidimensional_slicing[negative_indexing_single_element]❌ failure
test_indexing_ops.test_tril[2D_below_main_diagonal]❌ failure
test_indexing_ops.test_tril[2D_rectangular]❌ failure
test_matmul.test_matmul[1-7-7-1]❌ failure
test_matmul.test_matmul[1-7-7-7]❌ failure
test_matmul.test_matmul[1-7-32-32]❌ failure
test_matmul.test_matmul[1-7-41-1]❌ failure
test_matmul.test_matmul[1-7-41-7]❌ failure
test_matmul.test_matmul[1-7-64-32]❌ failure
test_matmul.test_matmul[1-32-7-1]❌ failure
test_matmul.test_matmul[1-32-7-7]❌ failure
test_matmul.test_matmul[1-32-32-32]❌ failure
test_matmul.test_matmul[1-32-41-1]❌ failure
test_matmul.test_matmul[1-32-41-7]❌ failure
test_matmul.test_matmul[1-32-64-32]❌ failure
test_matmul.test_matmul[1-41-7-1]❌ failure
test_matmul.test_matmul[1-41-7-7]❌ failure
test_matmul.test_matmul[1-41-32-32]❌ failure
test_matmul.test_matmul[1-41-41-1]❌ failure
test_matmul.test_matmul[1-41-41-7]❌ failure
test_matmul.test_matmul[1-41-64-32]❌ failure
test_matmul.test_matmul[1-64-7-1]❌ failure
test_matmul.test_matmul[1-64-7-7]❌ failure
test_matmul.test_matmul[1-64-32-32]❌ failure
test_matmul.test_matmul[1-64-41-1]❌ failure
test_matmul.test_matmul[1-64-41-7]❌ failure
test_matmul.test_matmul[1-64-64-32]❌ failure
test_matmul.test_matmul[7-7-7-1]❌ failure
test_matmul.test_matmul[7-7-7-7]❌ failure
test_matmul.test_matmul[7-7-32-32]❌ failure
test_matmul.test_matmul[7-7-41-1]❌ failure
test_matmul.test_matmul[7-7-41-7]❌ failure
test_matmul.test_matmul[7-7-64-32]❌ failure
test_matmul.test_matmul[7-32-7-1]❌ failure
test_matmul.test_matmul[7-32-7-7]❌ failure
test_matmul.test_matmul[7-32-32-32]❌ failure
test_matmul.test_matmul[7-32-41-1]❌ failure
test_matmul.test_matmul[7-32-41-7]❌ failure
test_matmul.test_matmul[7-32-64-32]❌ failure
test_matmul.test_matmul[7-41-7-1]❌ failure
test_matmul.test_matmul[7-41-7-7]❌ failure
test_matmul.test_matmul[7-41-32-32]❌ failure
test_matmul.test_matmul[7-41-41-1]❌ failure
test_matmul.test_matmul[7-41-41-7]❌ failure
test_matmul.test_matmul[7-41-64-32]❌ failure
test_matmul.test_matmul[7-64-7-1]❌ failure
test_matmul.test_matmul[7-64-7-7]❌ failure
test_matmul.test_matmul[7-64-32-32]❌ failure
test_matmul.test_matmul[7-64-41-1]❌ failure
test_matmul.test_matmul[7-64-41-7]❌ failure
test_matmul.test_matmul[7-64-64-32]❌ failure
test_matmul.test_matmul[32-7-7-1]❌ failure
test_matmul.test_matmul[32-7-7-7]❌ failure
test_matmul.test_matmul[32-7-32-32]❌ failure
test_matmul.test_matmul[32-7-41-1]❌ failure
test_matmul.test_matmul[32-7-41-7]❌ failure
test_matmul.test_matmul[32-7-64-32]❌ failure
test_matmul.test_matmul[32-32-7-1]❌ failure
test_matmul.test_matmul[32-32-7-7]❌ failure
test_matmul.test_matmul[32-32-32-32]❌ failure
test_matmul.test_matmul[32-32-41-1]❌ failure
test_matmul.test_matmul[32-32-41-7]❌ failure
test_matmul.test_matmul[32-32-64-32]❌ failure
test_matmul.test_matmul[32-41-7-1]❌ failure
test_matmul.test_matmul[32-41-7-7]❌ failure
test_matmul.test_matmul[32-41-32-32]❌ failure
test_matmul.test_matmul[32-41-41-1]❌ failure
test_matmul.test_matmul[32-41-41-7]❌ failure
test_matmul.test_matmul[32-41-64-32]❌ failure
test_matmul.test_matmul[32-64-7-1]❌ failure
test_matmul.test_matmul[32-64-7-7]❌ failure
test_matmul.test_matmul[32-64-32-32]❌ failure
test_matmul.test_matmul[32-64-41-1]❌ failure
test_matmul.test_matmul[32-64-41-7]❌ failure
test_matmul.test_matmul[32-64-64-32]❌ failure
test_matmul.test_matmul[41-7-7-1]❌ failure
test_matmul.test_matmul[41-7-7-7]❌ failure
test_matmul.test_matmul[41-7-32-32]❌ failure
test_matmul.test_matmul[41-7-41-1]❌ failure
test_matmul.test_matmul[41-7-41-7]❌ failure
test_matmul.test_matmul[41-7-64-32]❌ failure
test_matmul.test_matmul[41-32-7-1]❌ failure
test_matmul.test_matmul[41-32-7-7]❌ failure
test_matmul.test_matmul[41-32-32-32]❌ failure
test_matmul.test_matmul[41-32-41-1]❌ failure
test_matmul.test_matmul[41-32-41-7]❌ failure
test_matmul.test_matmul[41-32-64-32]❌ failure
test_matmul.test_matmul[41-41-7-1]❌ failure
test_matmul.test_matmul[41-41-7-7]❌ failure
test_matmul.test_matmul[41-41-32-32]❌ failure
test_matmul.test_matmul[41-41-41-1]❌ failure
test_matmul.test_matmul[41-41-41-7]❌ failure
test_matmul.test_matmul[41-41-64-32]❌ failure
test_matmul.test_matmul[41-64-7-1]❌ failure
test_matmul.test_matmul[41-64-7-7]❌ failure
test_matmul.test_matmul[41-64-32-32]❌ failure
test_matmul.test_matmul[41-64-41-1]❌ failure
test_matmul.test_matmul[41-64-41-7]❌ failure
test_matmul.test_matmul[41-64-64-32]❌ failure
test_matmul.test_matmul[64-7-7-1]❌ failure
test_matmul.test_matmul[64-7-7-7]❌ failure
test_matmul.test_matmul[64-7-32-32]❌ failure
test_matmul.test_matmul[64-7-41-1]❌ failure
test_matmul.test_matmul[64-7-41-7]❌ failure
test_matmul.test_matmul[64-7-64-32]❌ failure
test_matmul.test_matmul[64-32-7-1]❌ failure
test_matmul.test_matmul[64-32-7-7]❌ failure
test_matmul.test_matmul[64-32-32-32]❌ failure
test_matmul.test_matmul[64-32-41-1]❌ failure
test_matmul.test_matmul[64-32-41-7]❌ failure
test_matmul.test_matmul[64-32-64-32]❌ failure
test_matmul.test_matmul[64-41-7-1]❌ failure
test_matmul.test_matmul[64-41-7-7]❌ failure
test_matmul.test_matmul[64-41-32-32]❌ failure
test_matmul.test_matmul[64-41-41-1]❌ failure
test_matmul.test_matmul[64-41-41-7]❌ failure
test_matmul.test_matmul[64-41-64-32]❌ failure
test_matmul.test_matmul[64-64-7-1]❌ failure
test_matmul.test_matmul[64-64-7-7]❌ failure
test_matmul.test_matmul[64-64-32-32]❌ failure
test_matmul.test_matmul[64-64-41-1]❌ failure
test_matmul.test_matmul[64-64-41-7]❌ failure
test_matmul.test_matmul[64-64-64-32]❌ failure
test_nn.test_avgpool3d[shape0-kernel_size0-stride0]❌ failure
test_nn.test_avgpool3d[shape2-kernel_size2-stride2]❌ failure
test_nn.test_avgpool3d[shape4-kernel_size4-stride4]❌ failure
test_nn.test_avgpool3d[shape6-kernel_size6-stride6]❌ failure
test_nn.test_maxpool2d[input_shape5-3-2-0-False]❌ failure
test_nn.test_maxpool2d[input_shape7-3-2-0-False]❌ failure
test_nn.test_batchnorm2d[1-256-28-28]❌ failure
test_nn.test_batchnorm2d[1-32-56-561]❌ failure
test_nn.test_embedding[3200-12-32000]❌ failure
test_reduce.test_reduce_sum[input_shape0-0-True]❌ failure
test_reduce.test_reduce_sum[input_shape2-0-True]❌ failure
test_reduce.test_reduce_sum[input_shape4-0-True]❌ failure
test_reduce.test_reduce_sum[input_shape6--2-True]❌ failure
test_reduce.test_reduce_sum[input_shape8-2-True]❌ failure
test_reduce.test_reduce_sum[input_shape10--4-True]❌ failure
test_reduce.test_reduce_sum[input_shape14--2-False]❌ failure
test_reduce.test_reduce_sum[input_shape16-2-False]❌ failure
test_reduce.test_reduce_sum[input_shape18-0-False]❌ failure
test_reduce.test_reduce_sum[input_shape21--4-False]❌ failure
test_reduce.test_reduce_mean[input_shape0-0-True]❌ failure
test_reduce.test_reduce_mean[input_shape2-0-True]❌ failure
test_reduce.test_reduce_mean[input_shape4-0-True]❌ failure
test_reduce.test_reduce_mean[input_shape6--2-True]❌ failure
test_reduce.test_reduce_mean[input_shape8-2-True]❌ failure
test_reduce.test_reduce_mean[input_shape10--4-True]❌ failure
test_reduce.test_reduce_mean[input_shape14--2-False]❌ failure
test_reduce.test_reduce_mean[input_shape16-2-False]❌ failure
test_reduce.test_reduce_mean[input_shape18-0-False]❌ failure
test_reduce.test_reduce_mean[input_shape21--4-False]❌ failure
test_reduce.test_mean[1-7-41]❌ failure
test_reduce.test_mean[1-32-41]❌ failure
test_reduce.test_mean[1-41-7]❌ failure
test_reduce.test_mean[1-41-32]❌ failure
test_reduce.test_mean[2-7-7]❌ failure
test_reduce.test_mean[2-7-32]❌ failure
test_reduce.test_mean[2-32-7]❌ failure
test_reduce.test_mean[2-32-32]❌ failure
test_reduce.test_mean[2-41-41]❌ failure
test_reduce.test_reduce_max[input_shape0-0-True]❌ failure
test_reduce.test_reduce_max[input_shape2-0-True]❌ failure
test_reduce.test_reduce_max[input_shape4-0-True]❌ failure
test_reduce.test_reduce_max[input_shape6--2-True]❌ failure
test_reduce.test_reduce_max[input_shape8-2-True]❌ failure
test_reduce.test_reduce_max[input_shape10--4-True]❌ failure
test_reduce.test_reduce_max[input_shape14--2-False]❌ failure
test_reduce.test_reduce_max[input_shape16-2-False]❌ failure
test_reduce.test_reduce_max[input_shape18-0-False]❌ failure
test_reduce.test_reduce_max[input_shape21--4-False]❌ failure
test_tm.test_index[shape1-2--403]❌ failure
test_tm.test_index[shape3--3--21]❌ failure
test_tm.test_index[shape5--1-36]❌ failure
test_tm.test_index[shape7--2--1]❌ failure
test_tm.test_index[shape9-1-50]❌ failure
test_tm.test_index[shape11--1-15]❌ failure
test_tm.test_index[shape13--3--12]❌ failure
test_tm.test_flatten[shape1]❌ failure
test_tm.test_flatten[shape3]❌ failure
test_tm.test_flatten[shape5]❌ failure
test_tm.test_flatten[shape7]❌ failure
test_tm.test_flatten[shape9]❌ failure
test_tm.test_cast[operand_and_cast_dtype1]❌ failure
test_tm.test_layernorm[1-32-56-56]❌ failure
test_tm.test_transpose[params1-data_format1]❌ failure
test_tm.test_transpose[params3-data_format3]❌ failure
test_tm.test_transpose[params5-data_format5]❌ failure
test_tm.test_transpose[params7-data_format7]❌ failure
test_tm.test_transpose[params9-data_format9]❌ failure
test_tm.test_transpose[params11-data_format11]❌ failure
test_tm.test_transpose[params13-data_format13]❌ failure
test_tm.test_transpose[params15-data_format15]❌ failure
test_tm.test_transpose[params17-data_format17]❌ failure
test_tm.test_transpose[params19-data_format19]❌ failure
test_tm.test_transpose[params20-data_format20]❌ failure
test_tm.test_reshape[1]❌ failure
test_tm.test_reshape[2]❌ failure
test_tm.test_reshape[4]❌ failure
test_tm.test_reshape[6]❌ failure
test_tm.test_reshape[8]❌ failure
test_tm.test_reshape[10]❌ failure
test_tm.test_reshape[12]❌ failure
test_tm.test_reshape[14]❌ failure
test_tm.test_reshape[16]❌ failure
test_tm.test_reshape[18]❌ failure
test_tm.test_reshape[21]❌ failure
test_tm.test_squeeze[input_shape_and_dim0]❌ failure
test_tm.test_squeeze[input_shape_and_dim2]❌ failure
test_tm.test_squeeze[input_shape_and_dim4]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim0]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim2]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim4]❌ failure
test_tm.test_reshape_pytorch❌ failure
test_tm.test_broadcast_pytorch❌ failure
test_tm.test_expand❌ failure
test_tm.test_repeat_interleave[shape1-1-3]❌ failure
test_tm.test_repeat_interleave[shape2-0-2]❌ failure
test_tm.test_repeat_interleave[shape4-2-4]❌ failure
test_tm.test_repeat_interleave[shape6-1-3]❌ failure
test_tm.test_repeat_interleave[shape8--1-2]❌ failure
test_tm.test_repeat_interleave[shape11-0-2]❌ failure
test_tm.test_repeat_interleave[shape13-0-5]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_maxpool2d[act_shape1]❌ failure
test_ops_tf.test_maxpool2d[act_shape4]❌ failure
test_ops_tf.test_maxpool2d[act_shape5]❌ failure
test_ops_tf.test_maxpool2d[act_shape6]❌ failure
test_ops_tf.test_maxpool2d[act_shape7]❌ failure
test_ops_tf.test_maxpool2d[act_shape8]❌ failure
test_ops_tf.test_maxpool2d[act_shape9]❌ failure
test_ops_tf.test_maxpool2d[act_shape10]❌ failure
test_ops_tf.test_maxpool2d[act_shape11]❌ failure
test_ops_tf.test_maxpool2d[act_shape12]❌ failure
test_ops_tf.test_maxpool2d[act_shape13]❌ failure
test_ops_tf.test_maxpool2d[act_shape19]❌ failure
test_ops_tf.test_maxpool2d[act_shape22]❌ failure
test_ops_tf.test_maxpool2d[act_shape25]❌ failure
test_specific_ops_llama32.test_sine[shapes0]❌ failure
test_specific_ops_llama32.test_reduce_avg[shapes0]❌ failure
test_specific_ops_llama32.test_reciprocal[shapes0]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape0]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape1]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape2]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape3]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape4]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape5]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape6]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape7]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape8]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape9]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape10]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape11]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape12]❌ failure
test_specific_ops_llama32.test_softmax[shapes0]❌ failure
test_specific_ops_llama32.test_sqrt[shapes0]❌ failure
test_specific_ops_llama32.test_unsqueeze[input_shape_and_dim1]❌ failure
test_specific_ops_llama32.test_transpose[params0]❌ failure
test_specific_ops_llama32.test_transpose[params2]❌ failure
test_specific_ops_llama32.test_transpose[params4]❌ failure
test_specific_ops_llama32.test_transpose[params6]❌ failure
test_specific_ops_llama32.test_transpose[params8]❌ failure
test_specific_ops_llama32.test_transpose[params10]❌ failure
test_features.test_multiple_inputs❌ failure
test_features.test_matmul_bias[linear_features0-1]❌ failure
test_features.test_batch_size_inference[10-784-2]❌ failure
test_features.test_batch_size_inference[10-784-64]❌ failure
test_features.test_batch_size_training[10-784-2]❌ failure
test_features.test_batch_size_training[10-784-16]❌ failure
test_training.test_compile_optimizers[SGD]❌ failure
test_training.test_compile_optimizers[AdamW]❌ failure
test_vilt.test_vilt_question_answering_hf_pytorch[dandelin/vilt-b32-finetuned-vqa]❌ failure
test_dpr.test_dpr_context_encoder_pytorch[facebook/dpr-ctx_encoder-single-nq-base]❌ failure
test_mobilenet_v1.test_mobilenetv1_basic❌ failure
test_mobilenet_v3.test_mobilenetv3_basic[mobilenet_v3_large]❌ failure
test_resnext.test_resnext_101_torchhub_pytorch[resnext101_32x8d]❌ failure
test_training.test_mnist_training❌ failure
test_training.test_forge_vs_torch_gradients[0]❌ failure
test_training.test_forge_vs_torch_gradients[4]❌ failure
test_training.test_lora❌ failure
test_training.test_optimizer_device❌ failure
test_optimizers.test_sgd[shape0]❌ failure
test_optimizers.test_sgd[shape2]❌ failure
test_llama_embedding.test_llama_embedding[meta-llama/Llama-3.2-1B]❌ failure
test_llama_lm_head.test_llama_lm_head[openlm-research/open_llama_3b]❌ failure
test_llama_lm_head.test_llama_lm_head[meta-llama/Llama-3.2-1B]❌ failure
test_llama_mlp.test_llama_mlp[meta-llama/Llama-3.2-1B]❌ failure
test_llama_rotary_emb.test_llama_rotary_emb[meta-llama/Llama-3.2-1B]❌ failure
test_llama_self_attn.test_llama_self_attn[meta-llama/Llama-3.2-1B]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim0]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim1]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim2]❌ failure
test_specific_ops_llama32.test_cosine[shapes0]❌ failure
test_specific_ops_llama32.test_matmul[shapes0]❌ failure
test_specific_ops_llama32.test_matmul[shapes1]❌ failure
test_specific_ops_llama32.test_matmul[shapes2]❌ failure
test_specific_ops_llama32.test_matmul[shapes3]❌ failure
test_specific_ops_llama32.test_matmul[shapes4]❌ failure
test_specific_ops_llama32.test_matmul[shapes5]❌ failure
test_specific_ops_llama32.test_matmul[shapes6]❌ failure
test_specific_ops_llama32.test_matmul[shapes7]❌ failure
test_specific_ops_llama32.test_repeat_interleave[shape0-0-1]❌ failure
test_specific_ops_llama32.test_repeat_interleave[shape1-2-4]❌ failure
test_specific_ops_llama32.test_multiply[shapes0]❌ failure
test_specific_ops_llama32.test_multiply[shapes1]❌ failure
test_specific_ops_llama32.test_multiply[shapes2]❌ failure
test_specific_ops_llama32.test_multiply[shapes3]❌ failure
test_specific_ops_llama32.test_multiply[shapes4]❌ failure
test_specific_ops_llama32.test_multiply[shapes5]❌ failure
test_specific_ops_llama32.test_multiply[shapes6]❌ failure
test_specific_ops_llama32.test_multiply[shapes7]❌ failure
test_specific_ops_llama32.test_multiply[shapes8]❌ failure
test_specific_ops_llama32.test_sigmoid[shapes0]❌ failure
test_specific_ops_llama32.test_unsqueeze[input_shape_and_dim0]❌ failure
test_specific_ops_llama32.test_transpose[params1]❌ failure
test_specific_ops_llama32.test_transpose[params3]❌ failure
test_specific_ops_llama32.test_transpose[params5]❌ failure
test_specific_ops_llama32.test_transpose[params7]❌ failure
test_specific_ops_llama32.test_transpose[params9]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests672 ran68 passed136 skipped468 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_less[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_less[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_less[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_greater[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_greater[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_greater[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_greater[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_not_equal[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_not_equal[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_not_equal[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_not_equal[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_equal[shape0]❌ failure
test_eltwise_binary.test_equal[shape2]❌ failure
test_eltwise_binary.test_equal[shape4]❌ failure
test_eltwise_binary.test_equal[shape6]❌ failure
test_eltwise_binary.test_equal[shape8]❌ failure
test_eltwise_binary.test_equal[shape11]❌ failure
test_eltwise_binary.test_equal[shape13]❌ failure
test_eltwise_binary.test_equal[shape15]❌ failure
test_eltwise_binary.test_equal[shape17]❌ failure
test_eltwise_binary.test_equal[shape19]❌ failure
test_eltwise_binary.test_equal[shape20]❌ failure
test_eltwise_binary.test_equal[shape22]❌ failure
test_eltwise_binary.test_add❌ failure
test_eltwise_binary.test_greater_equal[dims1]❌ failure
test_eltwise_binary.test_multiply[shape0]❌ failure
test_eltwise_binary.test_remainder❌ failure
test_eltwise_nary.test_concat[0]❌ failure
test_eltwise_nary.test_concat[2]❌ failure
test_eltwise_nary.test_concat[-1]❌ failure
test_eltwise_nary.test_concat[-3]❌ failure
test_eltwise_unary.test_nan_to_num[shape4-dtype4]❌ failure
test_eltwise_unary.test_nan_to_num[shape6-dtype6]❌ failure
test_eltwise_unary.test_power[shape0]❌ failure
test_eltwise_unary.test_power[shape2]❌ failure
test_eltwise_unary.test_power[shape4]❌ failure
test_eltwise_unary.test_power[shape6]❌ failure
test_eltwise_unary.test_power[shape8]❌ failure
test_eltwise_unary.test_sin[shape0]❌ failure
test_eltwise_unary.test_leakyrelu[shape0]❌ failure
test_eltwise_unary.test_clip[shape1-6.0-0.0]❌ failure
test_eltwise_unary.test_clip[shape3-2.0--1.0]❌ failure
test_eltwise_unary.test_clip[shape5--0.5-0.5]❌ failure
test_eltwise_unary.test_clip[shape7--1.0-0.0]❌ failure
test_eltwise_unary.test_clip[shape9--0.5--0.2]❌ failure
test_eltwise_unary.test_clip[shape11--3.0--1.0]❌ failure
test_eltwise_unary.test_cumsum[56-0]❌ failure
test_eltwise_unary.test_abs[shape0]❌ failure
test_eltwise_unary.test_abs[shape1]❌ failure
test_eltwise_unary.test_abs[shape2]❌ failure
test_eltwise_unary.test_abs[shape3]❌ failure
test_eltwise_unary.test_abs[shape4]❌ failure
test_eltwise_unary.test_abs[shape5]❌ failure
test_eltwise_unary.test_exp[shape0]❌ failure
test_eltwise_unary.test_exp[shape2]❌ failure
test_eltwise_unary.test_exp[shape4]❌ failure
test_eltwise_unary.test_exp[shape6]❌ failure
test_eltwise_unary.test_log[shape0]❌ failure
test_eltwise_unary.test_log[shape1]❌ failure
test_eltwise_unary.test_log[shape2]❌ failure
test_eltwise_unary.test_log[28]❌ failure
test_eltwise_unary.test_log[shape5]❌ failure
test_eltwise_unary.test_log[shape7]❌ failure
test_eltwise_unary.test_log[shape9]❌ failure
test_eltwise_unary.test_log[shape12]❌ failure
test_eltwise_unary.test_log[shape14]❌ failure
test_eltwise_unary.test_log[shape17]❌ failure
test_eltwise_unary.test_log[64]❌ failure
test_eltwise_unary.test_log[shape21]❌ failure
test_eltwise_unary.test_sqrt[7-7]❌ failure
test_eltwise_unary.test_sqrt[7-32]❌ failure
test_eltwise_unary.test_sqrt[32-7]❌ failure
test_eltwise_unary.test_sqrt[32-32]❌ failure
test_eltwise_unary.test_sqrt[41-41]❌ failure
test_eltwise_unary.test_reciprocal[shape1]❌ failure
test_eltwise_unary.test_reciprocal[shape3]❌ failure
test_eltwise_unary.test_reciprocal[shape5]❌ failure
test_eltwise_unary.test_reciprocal[shape7]❌ failure
test_eltwise_unary.test_sigmoid[shape0]❌ failure
test_eltwise_unary.test_sigmoid[shape2]❌ failure
test_eltwise_unary.test_sigmoid[shape4]❌ failure
test_eltwise_unary.test_sigmoid[shape6]❌ failure
test_advanced_indexing.test_index_select[input_dim_index0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index2]❌ failure
test_advanced_masking.test_masked_fill[2d_masked_fill]❌ failure
test_advanced_slicing.test_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index3]❌ failure
test_advanced_slicing.test_select[input_dim_index5]❌ failure
test_advanced_slicing.test_split[input_tensor_sizes_dim1]❌ failure
test_advanced_slicing.test_chunk[input_tensor_chunks_dim2]❌ failure
test_advanced_slicing.test_narrow[narrow_dim_0]❌ failure
test_advanced_slicing.test_narrow[narrow_dim_2]❌ failure
test_advanced_slicing.test_narrow[negative_index_narrow_dim_1]❌ failure
test_basic_slicing.test_slicing[every_second_element]❌ failure
test_basic_slicing.test_slicing[slice_from_index_three_to_end]❌ failure
test_basic_slicing.test_multidimensional_slicing[slice_middle_columns]❌ failure
test_basic_slicing.test_multidimensional_slicing[add_new_axis]❌ failure
test_basic_slicing.test_multidimensional_slicing[keep_dimension_with_size_1]❌ failure
test_basic_slicing.test_multidimensional_slicing[negative_indexing_subrange]❌ failure
test_indexing_ops.test_tril[2D_main_diagonal]❌ failure
test_indexing_ops.test_tril[2D_above_main_diagonal]❌ failure
test_indexing_ops.test_tril[3D_tensor]❌ failure
test_matmul.test_matmul[1-7-7-32]❌ failure
test_matmul.test_matmul[1-7-32-1]❌ failure
test_matmul.test_matmul[1-7-32-7]❌ failure
test_matmul.test_matmul[1-7-41-32]❌ failure
test_matmul.test_matmul[1-7-64-1]❌ failure
test_matmul.test_matmul[1-7-64-7]❌ failure
test_matmul.test_matmul[1-32-7-32]❌ failure
test_matmul.test_matmul[1-32-32-1]❌ failure
test_matmul.test_matmul[1-32-32-7]❌ failure
test_matmul.test_matmul[1-32-41-32]❌ failure
test_matmul.test_matmul[1-32-64-1]❌ failure
test_matmul.test_matmul[1-32-64-7]❌ failure
test_matmul.test_matmul[1-41-7-32]❌ failure
test_matmul.test_matmul[1-41-32-1]❌ failure
test_matmul.test_matmul[1-41-32-7]❌ failure
test_matmul.test_matmul[1-41-41-32]❌ failure
test_matmul.test_matmul[1-41-64-1]❌ failure
test_matmul.test_matmul[1-41-64-7]❌ failure
test_matmul.test_matmul[1-64-7-32]❌ failure
test_matmul.test_matmul[1-64-32-1]❌ failure
test_matmul.test_matmul[1-64-32-7]❌ failure
test_matmul.test_matmul[1-64-41-32]❌ failure
test_matmul.test_matmul[1-64-64-1]❌ failure
test_matmul.test_matmul[1-64-64-7]❌ failure
test_matmul.test_matmul[7-7-7-32]❌ failure
test_matmul.test_matmul[7-7-32-1]❌ failure
test_matmul.test_matmul[7-7-32-7]❌ failure
test_matmul.test_matmul[7-7-41-32]❌ failure
test_matmul.test_matmul[7-7-64-1]❌ failure
test_matmul.test_matmul[7-7-64-7]❌ failure
test_matmul.test_matmul[7-32-7-32]❌ failure
test_matmul.test_matmul[7-32-32-1]❌ failure
test_matmul.test_matmul[7-32-32-7]❌ failure
test_matmul.test_matmul[7-32-41-32]❌ failure
test_matmul.test_matmul[7-32-64-1]❌ failure
test_matmul.test_matmul[7-32-64-7]❌ failure
test_matmul.test_matmul[7-41-7-32]❌ failure
test_matmul.test_matmul[7-41-32-1]❌ failure
test_matmul.test_matmul[7-41-32-7]❌ failure
test_matmul.test_matmul[7-41-41-32]❌ failure
test_matmul.test_matmul[7-41-64-1]❌ failure
test_matmul.test_matmul[7-41-64-7]❌ failure
test_matmul.test_matmul[7-64-7-32]❌ failure
test_matmul.test_matmul[7-64-32-1]❌ failure
test_matmul.test_matmul[7-64-32-7]❌ failure
test_matmul.test_matmul[7-64-41-32]❌ failure
test_matmul.test_matmul[7-64-64-1]❌ failure
test_matmul.test_matmul[7-64-64-7]❌ failure
test_matmul.test_matmul[32-7-7-32]❌ failure
test_matmul.test_matmul[32-7-32-1]❌ failure
test_matmul.test_matmul[32-7-32-7]❌ failure
test_matmul.test_matmul[32-7-41-32]❌ failure
test_matmul.test_matmul[32-7-64-1]❌ failure
test_matmul.test_matmul[32-7-64-7]❌ failure
test_matmul.test_matmul[32-32-7-32]❌ failure
test_matmul.test_matmul[32-32-32-1]❌ failure
test_matmul.test_matmul[32-32-32-7]❌ failure
test_matmul.test_matmul[32-32-41-32]❌ failure
test_matmul.test_matmul[32-32-64-1]❌ failure
test_matmul.test_matmul[32-32-64-7]❌ failure
test_matmul.test_matmul[32-41-7-32]❌ failure
test_matmul.test_matmul[32-41-32-1]❌ failure
test_matmul.test_matmul[32-41-32-7]❌ failure
test_matmul.test_matmul[32-41-41-32]❌ failure
test_matmul.test_matmul[32-41-64-1]❌ failure
test_matmul.test_matmul[32-41-64-7]❌ failure
test_matmul.test_matmul[32-64-7-32]❌ failure
test_matmul.test_matmul[32-64-32-1]❌ failure
test_matmul.test_matmul[32-64-32-7]❌ failure
test_matmul.test_matmul[32-64-41-32]❌ failure
test_matmul.test_matmul[32-64-64-1]❌ failure
test_matmul.test_matmul[32-64-64-7]❌ failure
test_matmul.test_matmul[41-7-7-32]❌ failure
test_matmul.test_matmul[41-7-32-1]❌ failure
test_matmul.test_matmul[41-7-32-7]❌ failure
test_matmul.test_matmul[41-7-41-32]❌ failure
test_matmul.test_matmul[41-7-64-1]❌ failure
test_matmul.test_matmul[41-7-64-7]❌ failure
test_matmul.test_matmul[41-32-7-32]❌ failure
test_matmul.test_matmul[41-32-32-1]❌ failure
test_matmul.test_matmul[41-32-32-7]❌ failure
test_matmul.test_matmul[41-32-41-32]❌ failure
test_matmul.test_matmul[41-32-64-1]❌ failure
test_matmul.test_matmul[41-32-64-7]❌ failure
test_matmul.test_matmul[41-41-7-32]❌ failure
test_matmul.test_matmul[41-41-32-1]❌ failure
test_matmul.test_matmul[41-41-32-7]❌ failure
test_matmul.test_matmul[41-41-41-32]❌ failure
test_matmul.test_matmul[41-41-64-1]❌ failure
test_matmul.test_matmul[41-41-64-7]❌ failure
test_matmul.test_matmul[41-64-7-32]❌ failure
test_matmul.test_matmul[41-64-32-1]❌ failure
test_matmul.test_matmul[41-64-32-7]❌ failure
test_matmul.test_matmul[41-64-41-32]❌ failure
test_matmul.test_matmul[41-64-64-1]❌ failure
test_matmul.test_matmul[41-64-64-7]❌ failure
test_matmul.test_matmul[64-7-7-32]❌ failure
test_matmul.test_matmul[64-7-32-1]❌ failure
test_matmul.test_matmul[64-7-32-7]❌ failure
test_matmul.test_matmul[64-7-41-32]❌ failure
test_matmul.test_matmul[64-7-64-1]❌ failure
test_matmul.test_matmul[64-7-64-7]❌ failure
test_matmul.test_matmul[64-32-7-32]❌ failure
test_matmul.test_matmul[64-32-32-1]❌ failure
test_matmul.test_matmul[64-32-32-7]❌ failure
test_matmul.test_matmul[64-32-41-32]❌ failure
test_matmul.test_matmul[64-32-64-1]❌ failure
test_matmul.test_matmul[64-32-64-7]❌ failure
test_matmul.test_matmul[64-41-7-32]❌ failure
test_matmul.test_matmul[64-41-32-1]❌ failure
test_matmul.test_matmul[64-41-32-7]❌ failure
test_matmul.test_matmul[64-41-41-32]❌ failure
test_matmul.test_matmul[64-41-64-1]❌ failure
test_matmul.test_matmul[64-41-64-7]❌ failure
test_matmul.test_matmul[64-64-7-32]❌ failure
test_matmul.test_matmul[64-64-32-1]❌ failure
test_matmul.test_matmul[64-64-32-7]❌ failure
test_matmul.test_matmul[64-64-41-32]❌ failure
test_matmul.test_matmul[64-64-64-1]❌ failure
test_matmul.test_matmul[64-64-64-7]❌ failure
test_nn.test_avgpool3d[shape1-kernel_size1-stride1]❌ failure
test_nn.test_avgpool3d[shape3-kernel_size3-stride3]❌ failure
test_nn.test_avgpool3d[shape5-kernel_size5-stride5]❌ failure
test_nn.test_maxpool2d[input_shape4-3-2-0-False]❌ failure
test_nn.test_maxpool2d[input_shape6-3-2-0-False]❌ failure
test_nn.test_batchnorm2d[1-32-56-560]❌ failure
test_nn.test_batchnorm2d[1-64-112-112]❌ failure
test_nn.test_batchnorm2d[1-128-224-224]❌ failure
test_nn.test_softmax❌ failure
test_nn.test_avg_pool2d❌ failure
test_reduce.test_reduce_sum[input_shape1--1-True]❌ failure
test_reduce.test_reduce_sum[input_shape3--2-True]❌ failure
test_reduce.test_reduce_sum[input_shape5-2-True]❌ failure
test_reduce.test_reduce_sum[input_shape7-0-True]❌ failure
test_reduce.test_reduce_sum[input_shape9--3-True]❌ failure
test_reduce.test_reduce_sum[input_shape13-0-False]❌ failure
test_reduce.test_reduce_sum[input_shape15-0-False]❌ failure
test_reduce.test_reduce_sum[input_shape17--2-False]❌ failure
test_reduce.test_reduce_sum[input_shape19-2-False]❌ failure
test_reduce.test_reduce_sum[input_shape20--3-False]❌ failure
test_reduce.test_reduce_mean[input_shape1--1-True]❌ failure
test_reduce.test_reduce_mean[input_shape3--2-True]❌ failure
test_reduce.test_reduce_mean[input_shape5-2-True]❌ failure
test_reduce.test_reduce_mean[input_shape7-0-True]❌ failure
test_reduce.test_reduce_mean[input_shape9--3-True]❌ failure
test_reduce.test_reduce_mean[input_shape13-0-False]❌ failure
test_reduce.test_reduce_mean[input_shape15-0-False]❌ failure
test_reduce.test_reduce_mean[input_shape17--2-False]❌ failure
test_reduce.test_reduce_mean[input_shape19-2-False]❌ failure
test_reduce.test_reduce_mean[input_shape20--3-False]❌ failure
test_reduce.test_mean[1-7-7]❌ failure
test_reduce.test_mean[1-7-32]❌ failure
test_reduce.test_mean[1-32-7]❌ failure
test_reduce.test_mean[1-32-32]❌ failure
test_reduce.test_mean[1-41-41]❌ failure
test_reduce.test_mean[2-7-41]❌ failure
test_reduce.test_mean[2-32-41]❌ failure
test_reduce.test_mean[2-41-7]❌ failure
test_reduce.test_mean[2-41-32]❌ failure
test_reduce.test_reduce_max[input_shape1--1-True]❌ failure
test_reduce.test_reduce_max[input_shape3--2-True]❌ failure
test_reduce.test_reduce_max[input_shape5-2-True]❌ failure
test_reduce.test_reduce_max[input_shape7-0-True]❌ failure
test_reduce.test_reduce_max[input_shape9--3-True]❌ failure
test_reduce.test_reduce_max[input_shape13-0-False]❌ failure
test_reduce.test_reduce_max[input_shape15-0-False]❌ failure
test_reduce.test_reduce_max[input_shape17--2-False]❌ failure
test_reduce.test_reduce_max[input_shape19-2-False]❌ failure
test_reduce.test_reduce_max[input_shape20--3-False]❌ failure
test_tm.test_index[shape0-1-21]❌ failure
test_tm.test_index[shape2-3-30]❌ failure
test_tm.test_index[shape4--2--103]❌ failure
test_tm.test_index[shape6-2--2]❌ failure
test_tm.test_index[shape8-0-2]❌ failure
test_tm.test_index[shape10-2--5]❌ failure
test_tm.test_index[shape12--2--20]❌ failure
test_tm.test_flatten[shape0]❌ failure
test_tm.test_flatten[shape2]❌ failure
test_tm.test_flatten[shape4]❌ failure
test_tm.test_flatten[shape6]❌ failure
test_tm.test_flatten[shape8]❌ failure
test_tm.test_cast[operand_and_cast_dtype0]❌ failure
test_tm.test_transpose[params0-data_format0]❌ failure
test_tm.test_transpose[params2-data_format2]❌ failure
test_tm.test_transpose[params4-data_format4]❌ failure
test_tm.test_transpose[params6-data_format6]❌ failure
test_tm.test_transpose[params8-data_format8]❌ failure
test_tm.test_transpose[params10-data_format10]❌ failure
test_tm.test_transpose[params12-data_format12]❌ failure
test_tm.test_transpose[params14-data_format14]❌ failure
test_tm.test_transpose[params16-data_format16]❌ failure
test_tm.test_transpose[params18-data_format18]❌ failure
test_tm.test_transpose[params21-data_format21]❌ failure
test_tm.test_reshape[3]❌ failure
test_tm.test_reshape[5]❌ failure
test_tm.test_reshape[7]❌ failure
test_tm.test_reshape[9]❌ failure
test_tm.test_reshape[11]❌ failure
test_tm.test_reshape[13]❌ failure
test_tm.test_reshape[15]❌ failure
test_tm.test_reshape[17]❌ failure
test_tm.test_reshape[19]❌ failure
test_tm.test_reshape[20]❌ failure
test_tm.test_reshape[22]❌ failure
test_tm.test_squeeze[input_shape_and_dim1]❌ failure
test_tm.test_squeeze[input_shape_and_dim3]❌ failure
test_tm.test_squeeze[input_shape_and_dim5]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim1]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim3]❌ failure
test_tm.test_repeat_interleave[shape0-0-2]❌ failure
test_tm.test_repeat_interleave[shape3-1-3]❌ failure
test_tm.test_repeat_interleave[shape5-0-3]❌ failure
test_tm.test_repeat_interleave[shape7-0-1]❌ failure
test_tm.test_repeat_interleave[shape9--2-3]❌ failure
test_tm.test_repeat_interleave[shape10--4-4]❌ failure
test_tm.test_repeat_interleave[shape12-2-3]❌ failure
test_tm.test_repeat_interleave[shape14-1-4]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_dual_conv2d❌ failure
test_ops_tf.test_maxpool2d[act_shape0]❌ failure
test_ops_tf.test_maxpool2d[act_shape2]❌ failure
test_ops_tf.test_maxpool2d[act_shape3]❌ failure
test_ops_tf.test_maxpool2d[act_shape14]❌ failure
test_ops_tf.test_maxpool2d[act_shape15]❌ failure
test_ops_tf.test_maxpool2d[act_shape16]❌ failure
test_ops_tf.test_maxpool2d[act_shape17]❌ failure
test_ops_tf.test_maxpool2d[act_shape18]❌ failure
test_ops_tf.test_maxpool2d[act_shape20]❌ failure
test_ops_tf.test_maxpool2d[act_shape21]❌ failure
test_ops_tf.test_maxpool2d[act_shape23]❌ failure
test_ops_tf.test_maxpool2d[act_shape24]❌ failure
test_ops_tf.test_maxpool2d[act_shape26]❌ failure
test_specific_ops_llama32.test_add[shapes0]❌ failure
test_specific_ops_llama32.test_add[shapes1]❌ failure
test_specific_ops_llama32.test_add[shapes2]❌ failure
test_specific_ops_llama32.test_add[shapes3]❌ failure
test_specific_ops_llama32.test_add[shapes4]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim0]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim1]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim2]❌ failure
test_specific_ops_llama32.test_cosine[shapes0]❌ failure
test_specific_ops_llama32.test_matmul[shapes0]❌ failure
test_specific_ops_llama32.test_matmul[shapes1]❌ failure
test_specific_ops_llama32.test_matmul[shapes2]❌ failure
test_specific_ops_llama32.test_matmul[shapes3]❌ failure
test_specific_ops_llama32.test_matmul[shapes4]❌ failure
test_specific_ops_llama32.test_matmul[shapes5]❌ failure
test_specific_ops_llama32.test_matmul[shapes6]❌ failure
test_specific_ops_llama32.test_matmul[shapes7]❌ failure
test_specific_ops_llama32.test_repeat_interleave[shape0-0-1]❌ failure
test_specific_ops_llama32.test_repeat_interleave[shape1-2-4]❌ failure
test_specific_ops_llama32.test_multiply[shapes0]❌ failure
test_specific_ops_llama32.test_multiply[shapes1]❌ failure
test_specific_ops_llama32.test_multiply[shapes2]❌ failure
test_specific_ops_llama32.test_multiply[shapes3]❌ failure
test_specific_ops_llama32.test_multiply[shapes4]❌ failure
test_specific_ops_llama32.test_multiply[shapes5]❌ failure
test_specific_ops_llama32.test_multiply[shapes6]❌ failure
test_specific_ops_llama32.test_multiply[shapes7]❌ failure
test_specific_ops_llama32.test_multiply[shapes8]❌ failure
test_specific_ops_llama32.test_sigmoid[shapes0]❌ failure
test_specific_ops_llama32.test_unsqueeze[input_shape_and_dim0]❌ failure
test_specific_ops_llama32.test_transpose[params1]❌ failure
test_specific_ops_llama32.test_transpose[params3]❌ failure
test_specific_ops_llama32.test_transpose[params5]❌ failure
test_specific_ops_llama32.test_transpose[params7]❌ failure
test_specific_ops_llama32.test_transpose[params9]❌ failure
test_features.test_input_order[a_shape0-b_shape0-c_shape0]❌ failure
test_features.test_matmul_bias[linear_features0-4]❌ failure
test_features.test_matmul_bias[linear_features0-16]❌ failure
test_features.test_matmul_bias[linear_features0-32]❌ failure
test_features.test_matmul_bias[linear_features0-64]❌ failure
test_features.test_batch_size_inference[10-784-1]❌ failure
test_features.test_batch_size_inference[10-784-16]❌ failure
test_features.test_batch_size_inference[10-784-512]❌ failure
test_features.test_batch_size_training[10-784-1]❌ failure
test_features.test_batch_size_training[10-784-64]❌ failure
test_features.test_batch_size_training[10-784-512]❌ failure
test_training.test_torch_training❌ failure
test_training.test_compile_optimizers[Adam]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v1]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v2]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v1]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v2]❌ failure
test_bert.test_bert_masked_lm_pytorch[bert-base-uncased]❌ failure
test_autoencoder.test_linear_ae_pytorch❌ failure
test_efficientnet.test_efficientnet_timm[efficientnet_b0]❌ failure
test_ghostnet.test_ghostnet_timm[ghostnet_100]❌ failure
test_mobilenet_v2.test_mobilenetv2_basic❌ failure
test_resnet.test_resnet_hf[microsoft/resnet-50]❌ failure
test_resnext.test_resnext_50_torchhub_pytorch[resnext50_32x4d]❌ failure
test_wideresnet.test_wideresnet_pytorch[wide_resnet50_2]❌ failure
test_inference.test_mnist_inference❌ failure
test_training.test_mnist_training_with_grad_accumulation❌ failure
test_training.test_forge_vs_torch_gradients[None]❌ failure
test_training.test_forge_vs_torch_gradients[2]❌ failure
test_training.test_loss_device❌ failure
test_optimizers.test_sgd[shape1]❌ failure
test_optimizers.test_adam[0.0-betas0-shape0]❌ failure
test_optimizers.test_adam[0.0-betas0-shape1]❌ failure
test_optimizers.test_adam[0.0-betas0-shape2]❌ failure
test_optimizers.test_adam[0.0-betas1-shape0]❌ failure
test_optimizers.test_adam[0.0-betas1-shape1]❌ failure
test_optimizers.test_adam[0.0-betas1-shape2]❌ failure
test_optimizers.test_adam[0.1-betas0-shape0]❌ failure
test_optimizers.test_adam[0.1-betas0-shape1]❌ failure
test_optimizers.test_adam[0.1-betas0-shape2]❌ failure
test_optimizers.test_adam[0.1-betas1-shape0]❌ failure
test_optimizers.test_adam[0.1-betas1-shape1]❌ failure
test_optimizers.test_adam[0.1-betas1-shape2]❌ failure
test_llama_embedding.test_llama_embedding[openlm-research/open_llama_3b]❌ failure
test_llama_mlp.test_llama_mlp[openlm-research/open_llama_3b]❌ failure
test_llama_rms_norm.test_llama_lm_head[openlm-research/open_llama_3b]❌ failure
test_llama_rms_norm.test_llama_lm_head[meta-llama/Llama-3.2-1B]❌ failure
test_llama_rotary_emb.test_llama_rotary_emb[openlm-research/open_llama_3b]❌ failure
test_llama_self_attn.test_llama_self_attn[openlm-research/open_llama_3b]❌ failure
test_specific_ops_llama32.test_add[shapes0]❌ failure
test_specific_ops_llama32.test_add[shapes1]❌ failure
test_specific_ops_llama32.test_add[shapes2]❌ failure
test_specific_ops_llama32.test_add[shapes3]❌ failure
test_specific_ops_llama32.test_add[shapes4]❌ failure
test_specific_ops_llama32.test_sine[shapes0]❌ failure
test_specific_ops_llama32.test_reduce_avg[shapes0]❌ failure
test_specific_ops_llama32.test_reciprocal[shapes0]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape0]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape1]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape2]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape3]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape4]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape5]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape6]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape7]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape8]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape9]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape10]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape11]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape12]❌ failure
test_specific_ops_llama32.test_softmax[shapes0]❌ failure
test_specific_ops_llama32.test_sqrt[shapes0]❌ failure
test_specific_ops_llama32.test_unsqueeze[input_shape_and_dim1]❌ failure
test_specific_ops_llama32.test_transpose[params0]❌ failure
test_specific_ops_llama32.test_transpose[params2]❌ failure
test_specific_ops_llama32.test_transpose[params4]❌ failure
test_specific_ops_llama32.test_transpose[params6]❌ failure
test_specific_ops_llama32.test_transpose[params8]❌ failure
test_specific_ops_llama32.test_transpose[params10]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests613 ran52 passed132 skipped429 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_less[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_less[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_less[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_greater[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_greater[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_greater[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_greater[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_not_equal[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_not_equal[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_not_equal[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_not_equal[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_equal[shape1]❌ failure
test_eltwise_binary.test_equal[shape3]❌ failure
test_eltwise_binary.test_equal[shape5]❌ failure
test_eltwise_binary.test_equal[shape7]❌ failure
test_eltwise_binary.test_equal[shape9]❌ failure
test_eltwise_binary.test_equal[shape10]❌ failure
test_eltwise_binary.test_equal[shape12]❌ failure
test_eltwise_binary.test_equal[shape14]❌ failure
test_eltwise_binary.test_equal[shape16]❌ failure
test_eltwise_binary.test_equal[shape18]❌ failure
test_eltwise_binary.test_equal[shape21]❌ failure
test_eltwise_binary.test_equal[shape23]❌ failure
test_eltwise_binary.test_greater_equal[dims0]❌ failure
test_eltwise_binary.test_greater_equal[dims2]❌ failure
test_eltwise_binary.test_subtract❌ failure
test_eltwise_binary.test_multiply[shape1]❌ failure
test_eltwise_nary.test_concat[1]❌ failure
test_eltwise_nary.test_concat[3]❌ failure
test_eltwise_nary.test_concat[-2]❌ failure
test_eltwise_nary.test_concat[-4]❌ failure
test_eltwise_unary.test_nan_to_num[shape1-dtype1]❌ failure
test_eltwise_unary.test_nan_to_num[shape7-dtype7]❌ failure
test_eltwise_unary.test_power[shape1]❌ failure
test_eltwise_unary.test_power[shape3]❌ failure
test_eltwise_unary.test_power[shape5]❌ failure
test_eltwise_unary.test_power[shape7]❌ failure
test_eltwise_unary.test_power[shape9]❌ failure
test_eltwise_unary.test_cosine[shape0]❌ failure
test_eltwise_unary.test_gelu[shape0]❌ failure
test_eltwise_unary.test_clip[shape0-0-1]❌ failure
test_eltwise_unary.test_clip[shape2--0.5-0.5]❌ failure
test_eltwise_unary.test_clip[shape4--3.0--1.0]❌ failure
test_eltwise_unary.test_clip[shape6-1.0--1.0]❌ failure
test_eltwise_unary.test_clip[shape8--0.2-0.2]❌ failure
test_eltwise_unary.test_clip[shape10-0.0-2.0]❌ failure
test_eltwise_unary.test_cumsum[shape1-1]❌ failure
test_eltwise_unary.test_exp[shape1]❌ failure
test_eltwise_unary.test_exp[shape3]❌ failure
test_eltwise_unary.test_exp[shape5]❌ failure
test_eltwise_unary.test_log[shape4]❌ failure
test_eltwise_unary.test_log[shape6]❌ failure
test_eltwise_unary.test_log[shape8]❌ failure
test_eltwise_unary.test_log[shape10]❌ failure
test_eltwise_unary.test_log[14]❌ failure
test_eltwise_unary.test_log[shape13]❌ failure
test_eltwise_unary.test_log[56]❌ failure
test_eltwise_unary.test_log[shape16]❌ failure
test_eltwise_unary.test_log[shape18]❌ failure
test_eltwise_unary.test_log[shape20]❌ failure
test_eltwise_unary.test_log[shape22]❌ failure
test_eltwise_unary.test_log[7]❌ failure
test_eltwise_unary.test_relu❌ failure
test_eltwise_unary.test_sqrt[7-41]❌ failure
test_eltwise_unary.test_sqrt[32-41]❌ failure
test_eltwise_unary.test_sqrt[41-7]❌ failure
test_eltwise_unary.test_sqrt[41-32]❌ failure
test_eltwise_unary.test_reciprocal[shape0]❌ failure
test_eltwise_unary.test_reciprocal[shape2]❌ failure
test_eltwise_unary.test_reciprocal[shape4]❌ failure
test_eltwise_unary.test_reciprocal[shape6]❌ failure
test_eltwise_unary.test_sigmoid[shape1]❌ failure
test_eltwise_unary.test_sigmoid[shape3]❌ failure
test_eltwise_unary.test_sigmoid[shape5]❌ failure
test_eltwise_unary.test_sigmoid[shape7]❌ failure
test_eltwise_unary.test_tanh[input_shape0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index1]❌ failure
test_advanced_masking.test_masked_fill[1d_masked_fill]❌ failure
test_advanced_slicing.test_select[input_dim_index0]❌ failure
test_advanced_slicing.test_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index4]❌ failure
test_advanced_slicing.test_split[input_tensor_sizes_dim0]❌ failure
test_advanced_slicing.test_split[input_tensor_sizes_dim2]❌ failure
test_advanced_slicing.test_chunk[input_tensor_chunks_dim1]❌ failure
test_advanced_slicing.test_narrow[narrow_dim_1]❌ failure
test_advanced_slicing.test_narrow[narrow_single_element_dim_0]❌ failure
test_basic_slicing.test_slicing[slice_with_step]❌ failure
test_basic_slicing.test_slicing[first_five_elements]❌ failure
test_basic_slicing.test_slicing[all_but_last]❌ failure
test_basic_slicing.test_multidimensional_slicing[slicing_across_multiple_dims]❌ failure
test_basic_slicing.test_multidimensional_slicing[rows_and_columns_subrange]❌ failure
test_basic_slicing.test_multidimensional_slicing[ellipsis_first_dim]❌ failure
test_basic_slicing.test_multidimensional_slicing[negative_indexing_single_element]❌ failure
test_indexing_ops.test_tril[2D_below_main_diagonal]❌ failure
test_indexing_ops.test_tril[2D_rectangular]❌ failure
test_matmul.test_matmul[1-7-7-1]❌ failure
test_matmul.test_matmul[1-7-7-7]❌ failure
test_matmul.test_matmul[1-7-32-32]❌ failure
test_matmul.test_matmul[1-7-41-1]❌ failure
test_matmul.test_matmul[1-7-41-7]❌ failure
test_matmul.test_matmul[1-7-64-32]❌ failure
test_matmul.test_matmul[1-32-7-1]❌ failure
test_matmul.test_matmul[1-32-7-7]❌ failure
test_matmul.test_matmul[1-32-32-32]❌ failure
test_matmul.test_matmul[1-32-41-1]❌ failure
test_matmul.test_matmul[1-32-41-7]❌ failure
test_matmul.test_matmul[1-32-64-32]❌ failure
test_matmul.test_matmul[1-41-7-1]❌ failure
test_matmul.test_matmul[1-41-7-7]❌ failure
test_matmul.test_matmul[1-41-32-32]❌ failure
test_matmul.test_matmul[1-41-41-1]❌ failure
test_matmul.test_matmul[1-41-41-7]❌ failure
test_matmul.test_matmul[1-41-64-32]❌ failure
test_matmul.test_matmul[1-64-7-1]❌ failure
test_matmul.test_matmul[1-64-7-7]❌ failure
test_matmul.test_matmul[1-64-32-32]❌ failure
test_matmul.test_matmul[1-64-41-1]❌ failure
test_matmul.test_matmul[1-64-41-7]❌ failure
test_matmul.test_matmul[1-64-64-32]❌ failure
test_matmul.test_matmul[7-7-7-1]❌ failure
test_matmul.test_matmul[7-7-7-7]❌ failure
test_matmul.test_matmul[7-7-32-32]❌ failure
test_matmul.test_matmul[7-7-41-1]❌ failure
test_matmul.test_matmul[7-7-41-7]❌ failure
test_matmul.test_matmul[7-7-64-32]❌ failure
test_matmul.test_matmul[7-32-7-1]❌ failure
test_matmul.test_matmul[7-32-7-7]❌ failure
test_matmul.test_matmul[7-32-32-32]❌ failure
test_matmul.test_matmul[7-32-41-1]❌ failure
test_matmul.test_matmul[7-32-41-7]❌ failure
test_matmul.test_matmul[7-32-64-32]❌ failure
test_matmul.test_matmul[7-41-7-1]❌ failure
test_matmul.test_matmul[7-41-7-7]❌ failure
test_matmul.test_matmul[7-41-32-32]❌ failure
test_matmul.test_matmul[7-41-41-1]❌ failure
test_matmul.test_matmul[7-41-41-7]❌ failure
test_matmul.test_matmul[7-41-64-32]❌ failure
test_matmul.test_matmul[7-64-7-1]❌ failure
test_matmul.test_matmul[7-64-7-7]❌ failure
test_matmul.test_matmul[7-64-32-32]❌ failure
test_matmul.test_matmul[7-64-41-1]❌ failure
test_matmul.test_matmul[7-64-41-7]❌ failure
test_matmul.test_matmul[7-64-64-32]❌ failure
test_matmul.test_matmul[32-7-7-1]❌ failure
test_matmul.test_matmul[32-7-7-7]❌ failure
test_matmul.test_matmul[32-7-32-32]❌ failure
test_matmul.test_matmul[32-7-41-1]❌ failure
test_matmul.test_matmul[32-7-41-7]❌ failure
test_matmul.test_matmul[32-7-64-32]❌ failure
test_matmul.test_matmul[32-32-7-1]❌ failure
test_matmul.test_matmul[32-32-7-7]❌ failure
test_matmul.test_matmul[32-32-32-32]❌ failure
test_matmul.test_matmul[32-32-41-1]❌ failure
test_matmul.test_matmul[32-32-41-7]❌ failure
test_matmul.test_matmul[32-32-64-32]❌ failure
test_matmul.test_matmul[32-41-7-1]❌ failure
test_matmul.test_matmul[32-41-7-7]❌ failure
test_matmul.test_matmul[32-41-32-32]❌ failure
test_matmul.test_matmul[32-41-41-1]❌ failure
test_matmul.test_matmul[32-41-41-7]❌ failure
test_matmul.test_matmul[32-41-64-32]❌ failure
test_matmul.test_matmul[32-64-7-1]❌ failure
test_matmul.test_matmul[32-64-7-7]❌ failure
test_matmul.test_matmul[32-64-32-32]❌ failure
test_matmul.test_matmul[32-64-41-1]❌ failure
test_matmul.test_matmul[32-64-41-7]❌ failure
test_matmul.test_matmul[32-64-64-32]❌ failure
test_matmul.test_matmul[41-7-7-1]❌ failure
test_matmul.test_matmul[41-7-7-7]❌ failure
test_matmul.test_matmul[41-7-32-32]❌ failure
test_matmul.test_matmul[41-7-41-1]❌ failure
test_matmul.test_matmul[41-7-41-7]❌ failure
test_matmul.test_matmul[41-7-64-32]❌ failure
test_matmul.test_matmul[41-32-7-1]❌ failure
test_matmul.test_matmul[41-32-7-7]❌ failure
test_matmul.test_matmul[41-32-32-32]❌ failure
test_matmul.test_matmul[41-32-41-1]❌ failure
test_matmul.test_matmul[41-32-41-7]❌ failure
test_matmul.test_matmul[41-32-64-32]❌ failure
test_matmul.test_matmul[41-41-7-1]❌ failure
test_matmul.test_matmul[41-41-7-7]❌ failure
test_matmul.test_matmul[41-41-32-32]❌ failure
test_matmul.test_matmul[41-41-41-1]❌ failure
test_matmul.test_matmul[41-41-41-7]❌ failure
test_matmul.test_matmul[41-41-64-32]❌ failure
test_matmul.test_matmul[41-64-7-1]❌ failure
test_matmul.test_matmul[41-64-7-7]❌ failure
test_matmul.test_matmul[41-64-32-32]❌ failure
test_matmul.test_matmul[41-64-41-1]❌ failure
test_matmul.test_matmul[41-64-41-7]❌ failure
test_matmul.test_matmul[41-64-64-32]❌ failure
test_matmul.test_matmul[64-7-7-1]❌ failure
test_matmul.test_matmul[64-7-7-7]❌ failure
test_matmul.test_matmul[64-7-32-32]❌ failure
test_matmul.test_matmul[64-7-41-1]❌ failure
test_matmul.test_matmul[64-7-41-7]❌ failure
test_matmul.test_matmul[64-7-64-32]❌ failure
test_matmul.test_matmul[64-32-7-1]❌ failure
test_matmul.test_matmul[64-32-7-7]❌ failure
test_matmul.test_matmul[64-32-32-32]❌ failure
test_matmul.test_matmul[64-32-41-1]❌ failure
test_matmul.test_matmul[64-32-41-7]❌ failure
test_matmul.test_matmul[64-32-64-32]❌ failure
test_matmul.test_matmul[64-41-7-1]❌ failure
test_matmul.test_matmul[64-41-7-7]❌ failure
test_matmul.test_matmul[64-41-32-32]❌ failure
test_matmul.test_matmul[64-41-41-1]❌ failure
test_matmul.test_matmul[64-41-41-7]❌ failure
test_matmul.test_matmul[64-41-64-32]❌ failure
test_matmul.test_matmul[64-64-7-1]❌ failure
test_matmul.test_matmul[64-64-7-7]❌ failure
test_matmul.test_matmul[64-64-32-32]❌ failure
test_matmul.test_matmul[64-64-41-1]❌ failure
test_matmul.test_matmul[64-64-41-7]❌ failure
test_matmul.test_matmul[64-64-64-32]❌ failure
test_nn.test_avgpool3d[shape0-kernel_size0-stride0]❌ failure
test_nn.test_avgpool3d[shape2-kernel_size2-stride2]❌ failure
test_nn.test_avgpool3d[shape4-kernel_size4-stride4]❌ failure
test_nn.test_avgpool3d[shape6-kernel_size6-stride6]❌ failure
test_nn.test_maxpool2d[input_shape5-3-2-0-False]❌ failure
test_nn.test_maxpool2d[input_shape7-3-2-0-False]❌ failure
test_nn.test_batchnorm2d[1-256-28-28]❌ failure
test_nn.test_batchnorm2d[1-32-56-561]❌ failure
test_nn.test_embedding[3200-12-32000]❌ failure
test_reduce.test_reduce_sum[input_shape0-0-True]❌ failure
test_reduce.test_reduce_sum[input_shape2-0-True]❌ failure
test_reduce.test_reduce_sum[input_shape4-0-True]❌ failure
test_reduce.test_reduce_sum[input_shape6--2-True]❌ failure
test_reduce.test_reduce_sum[input_shape8-2-True]❌ failure
test_reduce.test_reduce_sum[input_shape10--4-True]❌ failure
test_reduce.test_reduce_sum[input_shape14--2-False]❌ failure
test_reduce.test_reduce_sum[input_shape16-2-False]❌ failure
test_reduce.test_reduce_sum[input_shape18-0-False]❌ failure
test_reduce.test_reduce_sum[input_shape21--4-False]❌ failure
test_reduce.test_reduce_mean[input_shape0-0-True]❌ failure
test_reduce.test_reduce_mean[input_shape2-0-True]❌ failure
test_reduce.test_reduce_mean[input_shape4-0-True]❌ failure
test_reduce.test_reduce_mean[input_shape6--2-True]❌ failure
test_reduce.test_reduce_mean[input_shape8-2-True]❌ failure
test_reduce.test_reduce_mean[input_shape10--4-True]❌ failure
test_reduce.test_reduce_mean[input_shape14--2-False]❌ failure
test_reduce.test_reduce_mean[input_shape16-2-False]❌ failure
test_reduce.test_reduce_mean[input_shape18-0-False]❌ failure
test_reduce.test_reduce_mean[input_shape21--4-False]❌ failure
test_reduce.test_mean[1-7-41]❌ failure
test_reduce.test_mean[1-32-41]❌ failure
test_reduce.test_mean[1-41-7]❌ failure
test_reduce.test_mean[1-41-32]❌ failure
test_reduce.test_mean[2-7-7]❌ failure
test_reduce.test_mean[2-7-32]❌ failure
test_reduce.test_mean[2-32-7]❌ failure
test_reduce.test_mean[2-32-32]❌ failure
test_reduce.test_mean[2-41-41]❌ failure
test_reduce.test_reduce_max[input_shape0-0-True]❌ failure
test_reduce.test_reduce_max[input_shape2-0-True]❌ failure
test_reduce.test_reduce_max[input_shape4-0-True]❌ failure
test_reduce.test_reduce_max[input_shape6--2-True]❌ failure
test_reduce.test_reduce_max[input_shape8-2-True]❌ failure
test_reduce.test_reduce_max[input_shape10--4-True]❌ failure
test_reduce.test_reduce_max[input_shape14--2-False]❌ failure
test_reduce.test_reduce_max[input_shape16-2-False]❌ failure
test_reduce.test_reduce_max[input_shape18-0-False]❌ failure
test_reduce.test_reduce_max[input_shape21--4-False]❌ failure
test_tm.test_index[shape1-2--403]❌ failure
test_tm.test_index[shape3--3--21]❌ failure
test_tm.test_index[shape5--1-36]❌ failure
test_tm.test_index[shape7--2--1]❌ failure
test_tm.test_index[shape9-1-50]❌ failure
test_tm.test_index[shape11--1-15]❌ failure
test_tm.test_index[shape13--3--12]❌ failure
test_tm.test_flatten[shape1]❌ failure
test_tm.test_flatten[shape3]❌ failure
test_tm.test_flatten[shape5]❌ failure
test_tm.test_flatten[shape7]❌ failure
test_tm.test_flatten[shape9]❌ failure
test_tm.test_cast[operand_and_cast_dtype1]❌ failure
test_tm.test_layernorm[1-32-56-56]❌ failure
test_tm.test_transpose[params1-data_format1]❌ failure
test_tm.test_transpose[params3-data_format3]❌ failure
test_tm.test_transpose[params5-data_format5]❌ failure
test_tm.test_transpose[params7-data_format7]❌ failure
test_tm.test_transpose[params9-data_format9]❌ failure
test_tm.test_transpose[params11-data_format11]❌ failure
test_tm.test_transpose[params13-data_format13]❌ failure
test_tm.test_transpose[params15-data_format15]❌ failure
test_tm.test_transpose[params17-data_format17]❌ failure
test_tm.test_transpose[params19-data_format19]❌ failure
test_tm.test_transpose[params20-data_format20]❌ failure
test_tm.test_reshape[1]❌ failure
test_tm.test_reshape[2]❌ failure
test_tm.test_reshape[4]❌ failure
test_tm.test_reshape[6]❌ failure
test_tm.test_reshape[8]❌ failure
test_tm.test_reshape[10]❌ failure
test_tm.test_reshape[12]❌ failure
test_tm.test_reshape[14]❌ failure
test_tm.test_reshape[16]❌ failure
test_tm.test_reshape[18]❌ failure
test_tm.test_reshape[21]❌ failure
test_tm.test_squeeze[input_shape_and_dim0]❌ failure
test_tm.test_squeeze[input_shape_and_dim2]❌ failure
test_tm.test_squeeze[input_shape_and_dim4]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim0]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim2]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim4]❌ failure
test_tm.test_reshape_pytorch❌ failure
test_tm.test_broadcast_pytorch❌ failure
test_tm.test_expand❌ failure
test_tm.test_repeat_interleave[shape1-1-3]❌ failure
test_tm.test_repeat_interleave[shape2-0-2]❌ failure
test_tm.test_repeat_interleave[shape4-2-4]❌ failure
test_tm.test_repeat_interleave[shape6-1-3]❌ failure
test_tm.test_repeat_interleave[shape8--1-2]❌ failure
test_tm.test_repeat_interleave[shape11-0-2]❌ failure
test_tm.test_repeat_interleave[shape13-0-5]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_maxpool2d[act_shape1]❌ failure
test_ops_tf.test_maxpool2d[act_shape4]❌ failure
test_ops_tf.test_maxpool2d[act_shape5]❌ failure
test_ops_tf.test_maxpool2d[act_shape6]❌ failure
test_ops_tf.test_maxpool2d[act_shape7]❌ failure
test_ops_tf.test_maxpool2d[act_shape8]❌ failure
test_ops_tf.test_maxpool2d[act_shape9]❌ failure
test_ops_tf.test_maxpool2d[act_shape10]❌ failure
test_ops_tf.test_maxpool2d[act_shape11]❌ failure
test_ops_tf.test_maxpool2d[act_shape12]❌ failure
test_ops_tf.test_maxpool2d[act_shape13]❌ failure
test_ops_tf.test_maxpool2d[act_shape19]❌ failure
test_ops_tf.test_maxpool2d[act_shape22]❌ failure
test_ops_tf.test_maxpool2d[act_shape25]❌ failure
test_specific_ops_llama32.test_sine[shapes0]❌ failure
test_specific_ops_llama32.test_reduce_avg[shapes0]❌ failure
test_specific_ops_llama32.test_reciprocal[shapes0]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape0]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape1]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape2]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape3]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape4]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape5]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape6]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape7]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape8]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape9]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape10]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape11]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape12]❌ failure
test_specific_ops_llama32.test_softmax[shapes0]❌ failure
test_specific_ops_llama32.test_sqrt[shapes0]❌ failure
test_specific_ops_llama32.test_unsqueeze[input_shape_and_dim1]❌ failure
test_specific_ops_llama32.test_transpose[params0]❌ failure
test_specific_ops_llama32.test_transpose[params2]❌ failure
test_specific_ops_llama32.test_transpose[params4]❌ failure
test_specific_ops_llama32.test_transpose[params6]❌ failure
test_specific_ops_llama32.test_transpose[params8]❌ failure
test_specific_ops_llama32.test_transpose[params10]❌ failure
test_features.test_multiple_inputs❌ failure
test_features.test_matmul_bias[linear_features0-1]❌ failure
test_features.test_batch_size_inference[10-784-2]❌ failure
test_features.test_batch_size_inference[10-784-64]❌ failure
test_features.test_batch_size_training[10-784-2]❌ failure
test_features.test_batch_size_training[10-784-16]❌ failure
test_training.test_compile_optimizers[SGD]❌ failure
test_training.test_compile_optimizers[AdamW]❌ failure
test_vilt.test_vilt_question_answering_hf_pytorch[dandelin/vilt-b32-finetuned-vqa]❌ failure
test_dpr.test_dpr_context_encoder_pytorch[facebook/dpr-ctx_encoder-single-nq-base]❌ failure
test_mobilenet_v1.test_mobilenetv1_basic❌ failure
test_mobilenet_v3.test_mobilenetv3_basic[mobilenet_v3_large]❌ failure
test_resnext.test_resnext_101_torchhub_pytorch[resnext101_32x8d]❌ failure
test_training.test_mnist_training❌ failure
test_training.test_forge_vs_torch_gradients[0]❌ failure
test_training.test_forge_vs_torch_gradients[4]❌ failure
test_training.test_lora❌ failure
test_training.test_optimizer_device❌ failure
test_optimizers.test_sgd[shape0]❌ failure
test_optimizers.test_sgd[shape2]❌ failure
test_llama_embedding.test_llama_embedding[meta-llama/Llama-3.2-1B]❌ failure
test_llama_lm_head.test_llama_lm_head[openlm-research/open_llama_3b]❌ failure
test_llama_lm_head.test_llama_lm_head[meta-llama/Llama-3.2-1B]❌ failure
test_llama_mlp.test_llama_mlp[meta-llama/Llama-3.2-1B]❌ failure
test_llama_rotary_emb.test_llama_rotary_emb[meta-llama/Llama-3.2-1B]❌ failure
test_llama_self_attn.test_llama_self_attn[meta-llama/Llama-3.2-1B]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim0]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim1]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim2]❌ failure
test_specific_ops_llama32.test_cosine[shapes0]❌ failure
test_specific_ops_llama32.test_matmul[shapes0]❌ failure
test_specific_ops_llama32.test_matmul[shapes1]❌ failure
test_specific_ops_llama32.test_matmul[shapes2]❌ failure
test_specific_ops_llama32.test_matmul[shapes3]❌ failure
test_specific_ops_llama32.test_matmul[shapes4]❌ failure
test_specific_ops_llama32.test_matmul[shapes5]❌ failure
test_specific_ops_llama32.test_matmul[shapes6]❌ failure
test_specific_ops_llama32.test_matmul[shapes7]❌ failure
test_specific_ops_llama32.test_repeat_interleave[shape0-0-1]❌ failure
test_specific_ops_llama32.test_repeat_interleave[shape1-2-4]❌ failure
test_specific_ops_llama32.test_multiply[shapes0]❌ failure
test_specific_ops_llama32.test_multiply[shapes1]❌ failure
test_specific_ops_llama32.test_multiply[shapes2]❌ failure
test_specific_ops_llama32.test_multiply[shapes3]❌ failure
test_specific_ops_llama32.test_multiply[shapes4]❌ failure
test_specific_ops_llama32.test_multiply[shapes5]❌ failure
test_specific_ops_llama32.test_multiply[shapes6]❌ failure
test_specific_ops_llama32.test_multiply[shapes7]❌ failure
test_specific_ops_llama32.test_multiply[shapes8]❌ failure
test_specific_ops_llama32.test_sigmoid[shapes0]❌ failure
test_specific_ops_llama32.test_unsqueeze[input_shape_and_dim0]❌ failure
test_specific_ops_llama32.test_transpose[params1]❌ failure
test_specific_ops_llama32.test_transpose[params3]❌ failure
test_specific_ops_llama32.test_transpose[params5]❌ failure
test_specific_ops_llama32.test_transpose[params7]❌ failure
test_specific_ops_llama32.test_transpose[params9]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests672 ran68 passed136 skipped468 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_less[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_less[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_less[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_greater[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_greater[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_greater[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_greater[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_not_equal[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_not_equal[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_not_equal[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_not_equal[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_equal[shape0]❌ failure
test_eltwise_binary.test_equal[shape2]❌ failure
test_eltwise_binary.test_equal[shape4]❌ failure
test_eltwise_binary.test_equal[shape6]❌ failure
test_eltwise_binary.test_equal[shape8]❌ failure
test_eltwise_binary.test_equal[shape11]❌ failure
test_eltwise_binary.test_equal[shape13]❌ failure
test_eltwise_binary.test_equal[shape15]❌ failure
test_eltwise_binary.test_equal[shape17]❌ failure
test_eltwise_binary.test_equal[shape19]❌ failure
test_eltwise_binary.test_equal[shape20]❌ failure
test_eltwise_binary.test_equal[shape22]❌ failure
test_eltwise_binary.test_add❌ failure
test_eltwise_binary.test_greater_equal[dims1]❌ failure
test_eltwise_binary.test_multiply[shape0]❌ failure
test_eltwise_binary.test_remainder❌ failure
test_eltwise_nary.test_concat[0]❌ failure
test_eltwise_nary.test_concat[2]❌ failure
test_eltwise_nary.test_concat[-1]❌ failure
test_eltwise_nary.test_concat[-3]❌ failure
test_eltwise_unary.test_nan_to_num[shape4-dtype4]❌ failure
test_eltwise_unary.test_nan_to_num[shape6-dtype6]❌ failure
test_eltwise_unary.test_power[shape0]❌ failure
test_eltwise_unary.test_power[shape2]❌ failure
test_eltwise_unary.test_power[shape4]❌ failure
test_eltwise_unary.test_power[shape6]❌ failure
test_eltwise_unary.test_power[shape8]❌ failure
test_eltwise_unary.test_sin[shape0]❌ failure
test_eltwise_unary.test_leakyrelu[shape0]❌ failure
test_eltwise_unary.test_clip[shape1-6.0-0.0]❌ failure
test_eltwise_unary.test_clip[shape3-2.0--1.0]❌ failure
test_eltwise_unary.test_clip[shape5--0.5-0.5]❌ failure
test_eltwise_unary.test_clip[shape7--1.0-0.0]❌ failure
test_eltwise_unary.test_clip[shape9--0.5--0.2]❌ failure
test_eltwise_unary.test_clip[shape11--3.0--1.0]❌ failure
test_eltwise_unary.test_cumsum[56-0]❌ failure
test_eltwise_unary.test_abs[shape0]❌ failure
test_eltwise_unary.test_abs[shape1]❌ failure
test_eltwise_unary.test_abs[shape2]❌ failure
test_eltwise_unary.test_abs[shape3]❌ failure
test_eltwise_unary.test_abs[shape4]❌ failure
test_eltwise_unary.test_abs[shape5]❌ failure
test_eltwise_unary.test_exp[shape0]❌ failure
test_eltwise_unary.test_exp[shape2]❌ failure
test_eltwise_unary.test_exp[shape4]❌ failure
test_eltwise_unary.test_exp[shape6]❌ failure
test_eltwise_unary.test_log[shape0]❌ failure
test_eltwise_unary.test_log[shape1]❌ failure
test_eltwise_unary.test_log[shape2]❌ failure
test_eltwise_unary.test_log[28]❌ failure
test_eltwise_unary.test_log[shape5]❌ failure
test_eltwise_unary.test_log[shape7]❌ failure
test_eltwise_unary.test_log[shape9]❌ failure
test_eltwise_unary.test_log[shape12]❌ failure
test_eltwise_unary.test_log[shape14]❌ failure
test_eltwise_unary.test_log[shape17]❌ failure
test_eltwise_unary.test_log[64]❌ failure
test_eltwise_unary.test_log[shape21]❌ failure
test_eltwise_unary.test_sqrt[7-7]❌ failure
test_eltwise_unary.test_sqrt[7-32]❌ failure
test_eltwise_unary.test_sqrt[32-7]❌ failure
test_eltwise_unary.test_sqrt[32-32]❌ failure
test_eltwise_unary.test_sqrt[41-41]❌ failure
test_eltwise_unary.test_reciprocal[shape1]❌ failure
test_eltwise_unary.test_reciprocal[shape3]❌ failure
test_eltwise_unary.test_reciprocal[shape5]❌ failure
test_eltwise_unary.test_reciprocal[shape7]❌ failure
test_eltwise_unary.test_sigmoid[shape0]❌ failure
test_eltwise_unary.test_sigmoid[shape2]❌ failure
test_eltwise_unary.test_sigmoid[shape4]❌ failure
test_eltwise_unary.test_sigmoid[shape6]❌ failure
test_advanced_indexing.test_index_select[input_dim_index0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index2]❌ failure
test_advanced_masking.test_masked_fill[2d_masked_fill]❌ failure
test_advanced_slicing.test_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index3]❌ failure
test_advanced_slicing.test_select[input_dim_index5]❌ failure
test_advanced_slicing.test_split[input_tensor_sizes_dim1]❌ failure
test_advanced_slicing.test_chunk[input_tensor_chunks_dim2]❌ failure
test_advanced_slicing.test_narrow[narrow_dim_0]❌ failure
test_advanced_slicing.test_narrow[narrow_dim_2]❌ failure
test_advanced_slicing.test_narrow[negative_index_narrow_dim_1]❌ failure
test_basic_slicing.test_slicing[every_second_element]❌ failure
test_basic_slicing.test_slicing[slice_from_index_three_to_end]❌ failure
test_basic_slicing.test_multidimensional_slicing[slice_middle_columns]❌ failure
test_basic_slicing.test_multidimensional_slicing[add_new_axis]❌ failure
test_basic_slicing.test_multidimensional_slicing[keep_dimension_with_size_1]❌ failure
test_basic_slicing.test_multidimensional_slicing[negative_indexing_subrange]❌ failure
test_indexing_ops.test_tril[2D_main_diagonal]❌ failure
test_indexing_ops.test_tril[2D_above_main_diagonal]❌ failure
test_indexing_ops.test_tril[3D_tensor]❌ failure
test_matmul.test_matmul[1-7-7-32]❌ failure
test_matmul.test_matmul[1-7-32-1]❌ failure
test_matmul.test_matmul[1-7-32-7]❌ failure
test_matmul.test_matmul[1-7-41-32]❌ failure
test_matmul.test_matmul[1-7-64-1]❌ failure
test_matmul.test_matmul[1-7-64-7]❌ failure
test_matmul.test_matmul[1-32-7-32]❌ failure
test_matmul.test_matmul[1-32-32-1]❌ failure
test_matmul.test_matmul[1-32-32-7]❌ failure
test_matmul.test_matmul[1-32-41-32]❌ failure
test_matmul.test_matmul[1-32-64-1]❌ failure
test_matmul.test_matmul[1-32-64-7]❌ failure
test_matmul.test_matmul[1-41-7-32]❌ failure
test_matmul.test_matmul[1-41-32-1]❌ failure
test_matmul.test_matmul[1-41-32-7]❌ failure
test_matmul.test_matmul[1-41-41-32]❌ failure
test_matmul.test_matmul[1-41-64-1]❌ failure
test_matmul.test_matmul[1-41-64-7]❌ failure
test_matmul.test_matmul[1-64-7-32]❌ failure
test_matmul.test_matmul[1-64-32-1]❌ failure
test_matmul.test_matmul[1-64-32-7]❌ failure
test_matmul.test_matmul[1-64-41-32]❌ failure
test_matmul.test_matmul[1-64-64-1]❌ failure
test_matmul.test_matmul[1-64-64-7]❌ failure
test_matmul.test_matmul[7-7-7-32]❌ failure
test_matmul.test_matmul[7-7-32-1]❌ failure
test_matmul.test_matmul[7-7-32-7]❌ failure
test_matmul.test_matmul[7-7-41-32]❌ failure
test_matmul.test_matmul[7-7-64-1]❌ failure
test_matmul.test_matmul[7-7-64-7]❌ failure
test_matmul.test_matmul[7-32-7-32]❌ failure
test_matmul.test_matmul[7-32-32-1]❌ failure
test_matmul.test_matmul[7-32-32-7]❌ failure
test_matmul.test_matmul[7-32-41-32]❌ failure
test_matmul.test_matmul[7-32-64-1]❌ failure
test_matmul.test_matmul[7-32-64-7]❌ failure
test_matmul.test_matmul[7-41-7-32]❌ failure
test_matmul.test_matmul[7-41-32-1]❌ failure
test_matmul.test_matmul[7-41-32-7]❌ failure
test_matmul.test_matmul[7-41-41-32]❌ failure
test_matmul.test_matmul[7-41-64-1]❌ failure
test_matmul.test_matmul[7-41-64-7]❌ failure
test_matmul.test_matmul[7-64-7-32]❌ failure
test_matmul.test_matmul[7-64-32-1]❌ failure
test_matmul.test_matmul[7-64-32-7]❌ failure
test_matmul.test_matmul[7-64-41-32]❌ failure
test_matmul.test_matmul[7-64-64-1]❌ failure
test_matmul.test_matmul[7-64-64-7]❌ failure
test_matmul.test_matmul[32-7-7-32]❌ failure
test_matmul.test_matmul[32-7-32-1]❌ failure
test_matmul.test_matmul[32-7-32-7]❌ failure
test_matmul.test_matmul[32-7-41-32]❌ failure
test_matmul.test_matmul[32-7-64-1]❌ failure
test_matmul.test_matmul[32-7-64-7]❌ failure
test_matmul.test_matmul[32-32-7-32]❌ failure
test_matmul.test_matmul[32-32-32-1]❌ failure
test_matmul.test_matmul[32-32-32-7]❌ failure
test_matmul.test_matmul[32-32-41-32]❌ failure
test_matmul.test_matmul[32-32-64-1]❌ failure
test_matmul.test_matmul[32-32-64-7]❌ failure
test_matmul.test_matmul[32-41-7-32]❌ failure
test_matmul.test_matmul[32-41-32-1]❌ failure
test_matmul.test_matmul[32-41-32-7]❌ failure
test_matmul.test_matmul[32-41-41-32]❌ failure
test_matmul.test_matmul[32-41-64-1]❌ failure
test_matmul.test_matmul[32-41-64-7]❌ failure
test_matmul.test_matmul[32-64-7-32]❌ failure
test_matmul.test_matmul[32-64-32-1]❌ failure
test_matmul.test_matmul[32-64-32-7]❌ failure
test_matmul.test_matmul[32-64-41-32]❌ failure
test_matmul.test_matmul[32-64-64-1]❌ failure
test_matmul.test_matmul[32-64-64-7]❌ failure
test_matmul.test_matmul[41-7-7-32]❌ failure
test_matmul.test_matmul[41-7-32-1]❌ failure
test_matmul.test_matmul[41-7-32-7]❌ failure
test_matmul.test_matmul[41-7-41-32]❌ failure
test_matmul.test_matmul[41-7-64-1]❌ failure
test_matmul.test_matmul[41-7-64-7]❌ failure
test_matmul.test_matmul[41-32-7-32]❌ failure
test_matmul.test_matmul[41-32-32-1]❌ failure
test_matmul.test_matmul[41-32-32-7]❌ failure
test_matmul.test_matmul[41-32-41-32]❌ failure
test_matmul.test_matmul[41-32-64-1]❌ failure
test_matmul.test_matmul[41-32-64-7]❌ failure
test_matmul.test_matmul[41-41-7-32]❌ failure
test_matmul.test_matmul[41-41-32-1]❌ failure
test_matmul.test_matmul[41-41-32-7]❌ failure
test_matmul.test_matmul[41-41-41-32]❌ failure
test_matmul.test_matmul[41-41-64-1]❌ failure
test_matmul.test_matmul[41-41-64-7]❌ failure
test_matmul.test_matmul[41-64-7-32]❌ failure
test_matmul.test_matmul[41-64-32-1]❌ failure
test_matmul.test_matmul[41-64-32-7]❌ failure
test_matmul.test_matmul[41-64-41-32]❌ failure
test_matmul.test_matmul[41-64-64-1]❌ failure
test_matmul.test_matmul[41-64-64-7]❌ failure
test_matmul.test_matmul[64-7-7-32]❌ failure
test_matmul.test_matmul[64-7-32-1]❌ failure
test_matmul.test_matmul[64-7-32-7]❌ failure
test_matmul.test_matmul[64-7-41-32]❌ failure
test_matmul.test_matmul[64-7-64-1]❌ failure
test_matmul.test_matmul[64-7-64-7]❌ failure
test_matmul.test_matmul[64-32-7-32]❌ failure
test_matmul.test_matmul[64-32-32-1]❌ failure
test_matmul.test_matmul[64-32-32-7]❌ failure
test_matmul.test_matmul[64-32-41-32]❌ failure
test_matmul.test_matmul[64-32-64-1]❌ failure
test_matmul.test_matmul[64-32-64-7]❌ failure
test_matmul.test_matmul[64-41-7-32]❌ failure
test_matmul.test_matmul[64-41-32-1]❌ failure
test_matmul.test_matmul[64-41-32-7]❌ failure
test_matmul.test_matmul[64-41-41-32]❌ failure
test_matmul.test_matmul[64-41-64-1]❌ failure
test_matmul.test_matmul[64-41-64-7]❌ failure
test_matmul.test_matmul[64-64-7-32]❌ failure
test_matmul.test_matmul[64-64-32-1]❌ failure
test_matmul.test_matmul[64-64-32-7]❌ failure
test_matmul.test_matmul[64-64-41-32]❌ failure
test_matmul.test_matmul[64-64-64-1]❌ failure
test_matmul.test_matmul[64-64-64-7]❌ failure
test_nn.test_avgpool3d[shape1-kernel_size1-stride1]❌ failure
test_nn.test_avgpool3d[shape3-kernel_size3-stride3]❌ failure
test_nn.test_avgpool3d[shape5-kernel_size5-stride5]❌ failure
test_nn.test_maxpool2d[input_shape4-3-2-0-False]❌ failure
test_nn.test_maxpool2d[input_shape6-3-2-0-False]❌ failure
test_nn.test_batchnorm2d[1-32-56-560]❌ failure
test_nn.test_batchnorm2d[1-64-112-112]❌ failure
test_nn.test_batchnorm2d[1-128-224-224]❌ failure
test_nn.test_softmax❌ failure
test_nn.test_avg_pool2d❌ failure
test_reduce.test_reduce_sum[input_shape1--1-True]❌ failure
test_reduce.test_reduce_sum[input_shape3--2-True]❌ failure
test_reduce.test_reduce_sum[input_shape5-2-True]❌ failure
test_reduce.test_reduce_sum[input_shape7-0-True]❌ failure
test_reduce.test_reduce_sum[input_shape9--3-True]❌ failure
test_reduce.test_reduce_sum[input_shape13-0-False]❌ failure
test_reduce.test_reduce_sum[input_shape15-0-False]❌ failure
test_reduce.test_reduce_sum[input_shape17--2-False]❌ failure
test_reduce.test_reduce_sum[input_shape19-2-False]❌ failure
test_reduce.test_reduce_sum[input_shape20--3-False]❌ failure
test_reduce.test_reduce_mean[input_shape1--1-True]❌ failure
test_reduce.test_reduce_mean[input_shape3--2-True]❌ failure
test_reduce.test_reduce_mean[input_shape5-2-True]❌ failure
test_reduce.test_reduce_mean[input_shape7-0-True]❌ failure
test_reduce.test_reduce_mean[input_shape9--3-True]❌ failure
test_reduce.test_reduce_mean[input_shape13-0-False]❌ failure
test_reduce.test_reduce_mean[input_shape15-0-False]❌ failure
test_reduce.test_reduce_mean[input_shape17--2-False]❌ failure
test_reduce.test_reduce_mean[input_shape19-2-False]❌ failure
test_reduce.test_reduce_mean[input_shape20--3-False]❌ failure
test_reduce.test_mean[1-7-7]❌ failure
test_reduce.test_mean[1-7-32]❌ failure
test_reduce.test_mean[1-32-7]❌ failure
test_reduce.test_mean[1-32-32]❌ failure
test_reduce.test_mean[1-41-41]❌ failure
test_reduce.test_mean[2-7-41]❌ failure
test_reduce.test_mean[2-32-41]❌ failure
test_reduce.test_mean[2-41-7]❌ failure
test_reduce.test_mean[2-41-32]❌ failure
test_reduce.test_reduce_max[input_shape1--1-True]❌ failure
test_reduce.test_reduce_max[input_shape3--2-True]❌ failure
test_reduce.test_reduce_max[input_shape5-2-True]❌ failure
test_reduce.test_reduce_max[input_shape7-0-True]❌ failure
test_reduce.test_reduce_max[input_shape9--3-True]❌ failure
test_reduce.test_reduce_max[input_shape13-0-False]❌ failure
test_reduce.test_reduce_max[input_shape15-0-False]❌ failure
test_reduce.test_reduce_max[input_shape17--2-False]❌ failure
test_reduce.test_reduce_max[input_shape19-2-False]❌ failure
test_reduce.test_reduce_max[input_shape20--3-False]❌ failure
test_tm.test_index[shape0-1-21]❌ failure
test_tm.test_index[shape2-3-30]❌ failure
test_tm.test_index[shape4--2--103]❌ failure
test_tm.test_index[shape6-2--2]❌ failure
test_tm.test_index[shape8-0-2]❌ failure
test_tm.test_index[shape10-2--5]❌ failure
test_tm.test_index[shape12--2--20]❌ failure
test_tm.test_flatten[shape0]❌ failure
test_tm.test_flatten[shape2]❌ failure
test_tm.test_flatten[shape4]❌ failure
test_tm.test_flatten[shape6]❌ failure
test_tm.test_flatten[shape8]❌ failure
test_tm.test_cast[operand_and_cast_dtype0]❌ failure
test_tm.test_transpose[params0-data_format0]❌ failure
test_tm.test_transpose[params2-data_format2]❌ failure
test_tm.test_transpose[params4-data_format4]❌ failure
test_tm.test_transpose[params6-data_format6]❌ failure
test_tm.test_transpose[params8-data_format8]❌ failure
test_tm.test_transpose[params10-data_format10]❌ failure
test_tm.test_transpose[params12-data_format12]❌ failure
test_tm.test_transpose[params14-data_format14]❌ failure
test_tm.test_transpose[params16-data_format16]❌ failure
test_tm.test_transpose[params18-data_format18]❌ failure
test_tm.test_transpose[params21-data_format21]❌ failure
test_tm.test_reshape[3]❌ failure
test_tm.test_reshape[5]❌ failure
test_tm.test_reshape[7]❌ failure
test_tm.test_reshape[9]❌ failure
test_tm.test_reshape[11]❌ failure
test_tm.test_reshape[13]❌ failure
test_tm.test_reshape[15]❌ failure
test_tm.test_reshape[17]❌ failure
test_tm.test_reshape[19]❌ failure
test_tm.test_reshape[20]❌ failure
test_tm.test_reshape[22]❌ failure
test_tm.test_squeeze[input_shape_and_dim1]❌ failure
test_tm.test_squeeze[input_shape_and_dim3]❌ failure
test_tm.test_squeeze[input_shape_and_dim5]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim1]❌ failure
test_tm.test_unsqueeze[input_shape_and_dim3]❌ failure
test_tm.test_repeat_interleave[shape0-0-2]❌ failure
test_tm.test_repeat_interleave[shape3-1-3]❌ failure
test_tm.test_repeat_interleave[shape5-0-3]❌ failure
test_tm.test_repeat_interleave[shape7-0-1]❌ failure
test_tm.test_repeat_interleave[shape9--2-3]❌ failure
test_tm.test_repeat_interleave[shape10--4-4]❌ failure
test_tm.test_repeat_interleave[shape12-2-3]❌ failure
test_tm.test_repeat_interleave[shape14-1-4]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[no_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_dual_conv2d❌ failure
test_ops_tf.test_maxpool2d[act_shape0]❌ failure
test_ops_tf.test_maxpool2d[act_shape2]❌ failure
test_ops_tf.test_maxpool2d[act_shape3]❌ failure
test_ops_tf.test_maxpool2d[act_shape14]❌ failure
test_ops_tf.test_maxpool2d[act_shape15]❌ failure
test_ops_tf.test_maxpool2d[act_shape16]❌ failure
test_ops_tf.test_maxpool2d[act_shape17]❌ failure
test_ops_tf.test_maxpool2d[act_shape18]❌ failure
test_ops_tf.test_maxpool2d[act_shape20]❌ failure
test_ops_tf.test_maxpool2d[act_shape21]❌ failure
test_ops_tf.test_maxpool2d[act_shape23]❌ failure
test_ops_tf.test_maxpool2d[act_shape24]❌ failure
test_ops_tf.test_maxpool2d[act_shape26]❌ failure
test_specific_ops_llama32.test_add[shapes0]❌ failure
test_specific_ops_llama32.test_add[shapes1]❌ failure
test_specific_ops_llama32.test_add[shapes2]❌ failure
test_specific_ops_llama32.test_add[shapes3]❌ failure
test_specific_ops_llama32.test_add[shapes4]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim0]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim1]❌ failure
test_specific_ops_llama32.test_concat[inputs_and_dim2]❌ failure
test_specific_ops_llama32.test_cosine[shapes0]❌ failure
test_specific_ops_llama32.test_matmul[shapes0]❌ failure
test_specific_ops_llama32.test_matmul[shapes1]❌ failure
test_specific_ops_llama32.test_matmul[shapes2]❌ failure
test_specific_ops_llama32.test_matmul[shapes3]❌ failure
test_specific_ops_llama32.test_matmul[shapes4]❌ failure
test_specific_ops_llama32.test_matmul[shapes5]❌ failure
test_specific_ops_llama32.test_matmul[shapes6]❌ failure
test_specific_ops_llama32.test_matmul[shapes7]❌ failure
test_specific_ops_llama32.test_repeat_interleave[shape0-0-1]❌ failure
test_specific_ops_llama32.test_repeat_interleave[shape1-2-4]❌ failure
test_specific_ops_llama32.test_multiply[shapes0]❌ failure
test_specific_ops_llama32.test_multiply[shapes1]❌ failure
test_specific_ops_llama32.test_multiply[shapes2]❌ failure
test_specific_ops_llama32.test_multiply[shapes3]❌ failure
test_specific_ops_llama32.test_multiply[shapes4]❌ failure
test_specific_ops_llama32.test_multiply[shapes5]❌ failure
test_specific_ops_llama32.test_multiply[shapes6]❌ failure
test_specific_ops_llama32.test_multiply[shapes7]❌ failure
test_specific_ops_llama32.test_multiply[shapes8]❌ failure
test_specific_ops_llama32.test_sigmoid[shapes0]❌ failure
test_specific_ops_llama32.test_unsqueeze[input_shape_and_dim0]❌ failure
test_specific_ops_llama32.test_transpose[params1]❌ failure
test_specific_ops_llama32.test_transpose[params3]❌ failure
test_specific_ops_llama32.test_transpose[params5]❌ failure
test_specific_ops_llama32.test_transpose[params7]❌ failure
test_specific_ops_llama32.test_transpose[params9]❌ failure
test_features.test_input_order[a_shape0-b_shape0-c_shape0]❌ failure
test_features.test_matmul_bias[linear_features0-4]❌ failure
test_features.test_matmul_bias[linear_features0-16]❌ failure
test_features.test_matmul_bias[linear_features0-32]❌ failure
test_features.test_matmul_bias[linear_features0-64]❌ failure
test_features.test_batch_size_inference[10-784-1]❌ failure
test_features.test_batch_size_inference[10-784-16]❌ failure
test_features.test_batch_size_inference[10-784-512]❌ failure
test_features.test_batch_size_training[10-784-1]❌ failure
test_features.test_batch_size_training[10-784-64]❌ failure
test_features.test_batch_size_training[10-784-512]❌ failure
test_training.test_torch_training❌ failure
test_training.test_compile_optimizers[Adam]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v1]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v2]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v1]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v2]❌ failure
test_bert.test_bert_masked_lm_pytorch[bert-base-uncased]❌ failure
test_autoencoder.test_linear_ae_pytorch❌ failure
test_efficientnet.test_efficientnet_timm[efficientnet_b0]❌ failure
test_ghostnet.test_ghostnet_timm[ghostnet_100]❌ failure
test_mobilenet_v2.test_mobilenetv2_basic❌ failure
test_resnet.test_resnet_hf[microsoft/resnet-50]❌ failure
test_resnext.test_resnext_50_torchhub_pytorch[resnext50_32x4d]❌ failure
test_wideresnet.test_wideresnet_pytorch[wide_resnet50_2]❌ failure
test_inference.test_mnist_inference❌ failure
test_training.test_mnist_training_with_grad_accumulation❌ failure
test_training.test_forge_vs_torch_gradients[None]❌ failure
test_training.test_forge_vs_torch_gradients[2]❌ failure
test_training.test_loss_device❌ failure
test_optimizers.test_sgd[shape1]❌ failure
test_optimizers.test_adam[0.0-betas0-shape0]❌ failure
test_optimizers.test_adam[0.0-betas0-shape1]❌ failure
test_optimizers.test_adam[0.0-betas0-shape2]❌ failure
test_optimizers.test_adam[0.0-betas1-shape0]❌ failure
test_optimizers.test_adam[0.0-betas1-shape1]❌ failure
test_optimizers.test_adam[0.0-betas1-shape2]❌ failure
test_optimizers.test_adam[0.1-betas0-shape0]❌ failure
test_optimizers.test_adam[0.1-betas0-shape1]❌ failure
test_optimizers.test_adam[0.1-betas0-shape2]❌ failure
test_optimizers.test_adam[0.1-betas1-shape0]❌ failure
test_optimizers.test_adam[0.1-betas1-shape1]❌ failure
test_optimizers.test_adam[0.1-betas1-shape2]❌ failure
test_llama_embedding.test_llama_embedding[openlm-research/open_llama_3b]❌ failure
test_llama_mlp.test_llama_mlp[openlm-research/open_llama_3b]❌ failure
test_llama_rms_norm.test_llama_lm_head[openlm-research/open_llama_3b]❌ failure
test_llama_rms_norm.test_llama_lm_head[meta-llama/Llama-3.2-1B]❌ failure
test_llama_rotary_emb.test_llama_rotary_emb[openlm-research/open_llama_3b]❌ failure
test_llama_self_attn.test_llama_self_attn[openlm-research/open_llama_3b]❌ failure
test_specific_ops_llama32.test_add[shapes0]❌ failure
test_specific_ops_llama32.test_add[shapes1]❌ failure
test_specific_ops_llama32.test_add[shapes2]❌ failure
test_specific_ops_llama32.test_add[shapes3]❌ failure
test_specific_ops_llama32.test_add[shapes4]❌ failure
test_specific_ops_llama32.test_sine[shapes0]❌ failure
test_specific_ops_llama32.test_reduce_avg[shapes0]❌ failure
test_specific_ops_llama32.test_reciprocal[shapes0]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape0]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape1]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape2]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape3]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape4]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape5]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape6]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape7]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape8]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape9]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape10]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape11]❌ failure
test_specific_ops_llama32.test_reshape[source_and_target_shape12]❌ failure
test_specific_ops_llama32.test_softmax[shapes0]❌ failure
test_specific_ops_llama32.test_sqrt[shapes0]❌ failure
test_specific_ops_llama32.test_unsqueeze[input_shape_and_dim1]❌ failure
test_specific_ops_llama32.test_transpose[params0]❌ failure
test_specific_ops_llama32.test_transpose[params2]❌ failure
test_specific_ops_llama32.test_transpose[params4]❌ failure
test_specific_ops_llama32.test_transpose[params6]❌ failure
test_specific_ops_llama32.test_transpose[params8]❌ failure
test_specific_ops_llama32.test_transpose[params10]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests613 ran413 passed132 skipped68 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_less[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_less[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_less[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_greater[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_greater[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_greater[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_greater[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_not_equal[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_not_equal[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_not_equal[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_not_equal[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_equal[shape1]❌ failure
test_eltwise_binary.test_equal[shape3]❌ failure
test_eltwise_binary.test_equal[shape5]❌ failure
test_eltwise_binary.test_equal[shape7]❌ failure
test_eltwise_binary.test_equal[shape9]❌ failure
test_eltwise_binary.test_equal[shape10]❌ failure
test_eltwise_binary.test_equal[shape12]❌ failure
test_eltwise_binary.test_equal[shape14]❌ failure
test_eltwise_binary.test_equal[shape16]❌ failure
test_eltwise_binary.test_equal[shape18]❌ failure
test_eltwise_binary.test_equal[shape21]❌ failure
test_eltwise_binary.test_equal[shape23]❌ failure
test_eltwise_binary.test_greater_equal[dims0]❌ failure
test_eltwise_binary.test_greater_equal[dims2]❌ failure
test_eltwise_unary.test_nan_to_num[shape1-dtype1]❌ failure
test_eltwise_unary.test_nan_to_num[shape7-dtype7]❌ failure
test_advanced_indexing.test_index_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index0]❌ failure
test_advanced_slicing.test_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index4]❌ failure
test_basic_slicing.test_multidimensional_slicing[ellipsis_first_dim]❌ failure
test_tm.test_index[shape1-2--403]❌ failure
test_tm.test_index[shape3--3--21]❌ failure
test_tm.test_index[shape5--1-36]❌ failure
test_tm.test_index[shape7--2--1]❌ failure
test_tm.test_index[shape9-1-50]❌ failure
test_tm.test_index[shape11--1-15]❌ failure
test_tm.test_index[shape13--3--12]❌ failure
test_tm.test_reshape_pytorch❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_maxpool2d[act_shape1]❌ failure
test_ops_tf.test_maxpool2d[act_shape4]❌ failure
test_ops_tf.test_maxpool2d[act_shape5]❌ failure
test_ops_tf.test_maxpool2d[act_shape6]❌ failure
test_ops_tf.test_maxpool2d[act_shape7]❌ failure
test_ops_tf.test_maxpool2d[act_shape8]❌ failure
test_ops_tf.test_maxpool2d[act_shape9]❌ failure
test_ops_tf.test_maxpool2d[act_shape10]❌ failure
test_ops_tf.test_maxpool2d[act_shape11]❌ failure
test_ops_tf.test_maxpool2d[act_shape12]❌ failure
test_ops_tf.test_maxpool2d[act_shape13]❌ failure
test_ops_tf.test_maxpool2d[act_shape19]❌ failure
test_ops_tf.test_maxpool2d[act_shape22]❌ failure
test_ops_tf.test_maxpool2d[act_shape25]❌ failure
test_vilt.test_vilt_question_answering_hf_pytorch[dandelin/vilt-b32-finetuned-vqa]❌ failure
test_dpr.test_dpr_context_encoder_pytorch[facebook/dpr-ctx_encoder-single-nq-base]❌ failure
test_mobilenet_v3.test_mobilenetv3_basic[mobilenet_v3_large]❌ failure
test_llama_self_attn.test_llama_self_attn[meta-llama/Llama-3.2-1B]❌ failure

1 similar comment
Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests613 ran413 passed132 skipped68 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_less[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_less[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_less[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_greater[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_greater[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_greater[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_greater[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_not_equal[shape_x0-shape_y0]❌ failure
test_eltwise_binary.test_not_equal[shape_x2-shape_y2]❌ failure
test_eltwise_binary.test_not_equal[shape_x4-shape_y4]❌ failure
test_eltwise_binary.test_not_equal[shape_x6-shape_y6]❌ failure
test_eltwise_binary.test_equal[shape1]❌ failure
test_eltwise_binary.test_equal[shape3]❌ failure
test_eltwise_binary.test_equal[shape5]❌ failure
test_eltwise_binary.test_equal[shape7]❌ failure
test_eltwise_binary.test_equal[shape9]❌ failure
test_eltwise_binary.test_equal[shape10]❌ failure
test_eltwise_binary.test_equal[shape12]❌ failure
test_eltwise_binary.test_equal[shape14]❌ failure
test_eltwise_binary.test_equal[shape16]❌ failure
test_eltwise_binary.test_equal[shape18]❌ failure
test_eltwise_binary.test_equal[shape21]❌ failure
test_eltwise_binary.test_equal[shape23]❌ failure
test_eltwise_binary.test_greater_equal[dims0]❌ failure
test_eltwise_binary.test_greater_equal[dims2]❌ failure
test_eltwise_unary.test_nan_to_num[shape1-dtype1]❌ failure
test_eltwise_unary.test_nan_to_num[shape7-dtype7]❌ failure
test_advanced_indexing.test_index_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index0]❌ failure
test_advanced_slicing.test_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index4]❌ failure
test_basic_slicing.test_multidimensional_slicing[ellipsis_first_dim]❌ failure
test_tm.test_index[shape1-2--403]❌ failure
test_tm.test_index[shape3--3--21]❌ failure
test_tm.test_index[shape5--1-36]❌ failure
test_tm.test_index[shape7--2--1]❌ failure
test_tm.test_index[shape9-1-50]❌ failure
test_tm.test_index[shape11--1-15]❌ failure
test_tm.test_index[shape13--3--12]❌ failure
test_tm.test_reshape_pytorch❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-14-14-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-256-64-56-56-1-1-2-2]❌ failure
test_ops_tf.test_maxpool2d[act_shape1]❌ failure
test_ops_tf.test_maxpool2d[act_shape4]❌ failure
test_ops_tf.test_maxpool2d[act_shape5]❌ failure
test_ops_tf.test_maxpool2d[act_shape6]❌ failure
test_ops_tf.test_maxpool2d[act_shape7]❌ failure
test_ops_tf.test_maxpool2d[act_shape8]❌ failure
test_ops_tf.test_maxpool2d[act_shape9]❌ failure
test_ops_tf.test_maxpool2d[act_shape10]❌ failure
test_ops_tf.test_maxpool2d[act_shape11]❌ failure
test_ops_tf.test_maxpool2d[act_shape12]❌ failure
test_ops_tf.test_maxpool2d[act_shape13]❌ failure
test_ops_tf.test_maxpool2d[act_shape19]❌ failure
test_ops_tf.test_maxpool2d[act_shape22]❌ failure
test_ops_tf.test_maxpool2d[act_shape25]❌ failure
test_vilt.test_vilt_question_answering_hf_pytorch[dandelin/vilt-b32-finetuned-vqa]❌ failure
test_dpr.test_dpr_context_encoder_pytorch[facebook/dpr-ctx_encoder-single-nq-base]❌ failure
test_mobilenet_v3.test_mobilenetv3_basic[mobilenet_v3_large]❌ failure
test_llama_self_attn.test_llama_self_attn[meta-llama/Llama-3.2-1B]❌ failure

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests672 ran464 passed136 skipped72 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_less[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_less[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_less[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_greater[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_greater[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_greater[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_greater[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_not_equal[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_not_equal[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_not_equal[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_not_equal[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_equal[shape0]❌ failure
test_eltwise_binary.test_equal[shape2]❌ failure
test_eltwise_binary.test_equal[shape4]❌ failure
test_eltwise_binary.test_equal[shape6]❌ failure
test_eltwise_binary.test_equal[shape8]❌ failure
test_eltwise_binary.test_equal[shape11]❌ failure
test_eltwise_binary.test_equal[shape13]❌ failure
test_eltwise_binary.test_equal[shape15]❌ failure
test_eltwise_binary.test_equal[shape17]❌ failure
test_eltwise_binary.test_equal[shape19]❌ failure
test_eltwise_binary.test_equal[shape20]❌ failure
test_eltwise_binary.test_equal[shape22]❌ failure
test_eltwise_binary.test_greater_equal[dims1]❌ failure
test_eltwise_unary.test_nan_to_num[shape4-dtype4]❌ failure
test_eltwise_unary.test_nan_to_num[shape6-dtype6]❌ failure
test_advanced_indexing.test_index_select[input_dim_index0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index3]❌ failure
test_advanced_slicing.test_select[input_dim_index5]❌ failure
test_tm.test_index[shape0-1-21]❌ failure
test_tm.test_index[shape2-3-30]❌ failure
test_tm.test_index[shape4--2--103]❌ failure
test_tm.test_index[shape6-2--2]❌ failure
test_tm.test_index[shape8-0-2]❌ failure
test_tm.test_index[shape10-2--5]❌ failure
test_tm.test_index[shape12--2--20]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_dual_conv2d❌ failure
test_ops_tf.test_maxpool2d[act_shape0]❌ failure
test_ops_tf.test_maxpool2d[act_shape2]❌ failure
test_ops_tf.test_maxpool2d[act_shape3]❌ failure
test_ops_tf.test_maxpool2d[act_shape14]❌ failure
test_ops_tf.test_maxpool2d[act_shape15]❌ failure
test_ops_tf.test_maxpool2d[act_shape16]❌ failure
test_ops_tf.test_maxpool2d[act_shape17]❌ failure
test_ops_tf.test_maxpool2d[act_shape18]❌ failure
test_ops_tf.test_maxpool2d[act_shape20]❌ failure
test_ops_tf.test_maxpool2d[act_shape21]❌ failure
test_ops_tf.test_maxpool2d[act_shape23]❌ failure
test_ops_tf.test_maxpool2d[act_shape24]❌ failure
test_ops_tf.test_maxpool2d[act_shape26]❌ failure
test_features.test_input_order[a_shape0-b_shape0-c_shape0]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v1]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v2]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v1]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v2]❌ failure
test_bert.test_bert_masked_lm_pytorch[bert-base-uncased]❌ failure
test_efficientnet.test_efficientnet_timm[efficientnet_b0]❌ failure
test_ghostnet.test_ghostnet_timm[ghostnet_100]❌ failure
test_llama_self_attn.test_llama_self_attn[openlm-research/open_llama_3b]❌ failure

1 similar comment
Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests672 ran464 passed136 skipped72 failed
TestResult
TT-Forge-FE Tests
pytest
test_eltwise_binary.test_less[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_less[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_less[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_less[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_greater[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_greater[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_greater[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_greater[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_not_equal[shape_x1-shape_y1]❌ failure
test_eltwise_binary.test_not_equal[shape_x3-shape_y3]❌ failure
test_eltwise_binary.test_not_equal[shape_x5-shape_y5]❌ failure
test_eltwise_binary.test_not_equal[shape_x7-shape_y7]❌ failure
test_eltwise_binary.test_equal[shape0]❌ failure
test_eltwise_binary.test_equal[shape2]❌ failure
test_eltwise_binary.test_equal[shape4]❌ failure
test_eltwise_binary.test_equal[shape6]❌ failure
test_eltwise_binary.test_equal[shape8]❌ failure
test_eltwise_binary.test_equal[shape11]❌ failure
test_eltwise_binary.test_equal[shape13]❌ failure
test_eltwise_binary.test_equal[shape15]❌ failure
test_eltwise_binary.test_equal[shape17]❌ failure
test_eltwise_binary.test_equal[shape19]❌ failure
test_eltwise_binary.test_equal[shape20]❌ failure
test_eltwise_binary.test_equal[shape22]❌ failure
test_eltwise_binary.test_greater_equal[dims1]❌ failure
test_eltwise_unary.test_nan_to_num[shape4-dtype4]❌ failure
test_eltwise_unary.test_nan_to_num[shape6-dtype6]❌ failure
test_advanced_indexing.test_index_select[input_dim_index0]❌ failure
test_advanced_indexing.test_index_select[input_dim_index2]❌ failure
test_advanced_slicing.test_select[input_dim_index1]❌ failure
test_advanced_slicing.test_select[input_dim_index3]❌ failure
test_advanced_slicing.test_select[input_dim_index5]❌ failure
test_tm.test_index[shape0-1-21]❌ failure
test_tm.test_index[shape2-3-30]❌ failure
test_tm.test_index[shape4--2--103]❌ failure
test_tm.test_index[shape6-2--2]❌ failure
test_tm.test_index[shape8-0-2]❌ failure
test_tm.test_index[shape10-2--5]❌ failure
test_tm.test_index[shape12--2--20]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-56-56-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-128-128-28-28-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-28-28-3-3-2-2]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype0-weights_dtype1-1-256-256-7-7-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-16-115-115-4-4-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-56-56-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-8-8-3-3-1-1]❌ failure
test_ops_tf.test_conv2d[with_bias-activations_dtype1-weights_dtype1-1-64-64-16-16-3-3-1-1]❌ failure
test_ops_tf.test_dual_conv2d❌ failure
test_ops_tf.test_maxpool2d[act_shape0]❌ failure
test_ops_tf.test_maxpool2d[act_shape2]❌ failure
test_ops_tf.test_maxpool2d[act_shape3]❌ failure
test_ops_tf.test_maxpool2d[act_shape14]❌ failure
test_ops_tf.test_maxpool2d[act_shape15]❌ failure
test_ops_tf.test_maxpool2d[act_shape16]❌ failure
test_ops_tf.test_maxpool2d[act_shape17]❌ failure
test_ops_tf.test_maxpool2d[act_shape18]❌ failure
test_ops_tf.test_maxpool2d[act_shape20]❌ failure
test_ops_tf.test_maxpool2d[act_shape21]❌ failure
test_ops_tf.test_maxpool2d[act_shape23]❌ failure
test_ops_tf.test_maxpool2d[act_shape24]❌ failure
test_ops_tf.test_maxpool2d[act_shape26]❌ failure
test_features.test_input_order[a_shape0-b_shape0-c_shape0]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v1]❌ failure
test_albert.test_albert_masked_lm_pytorch[base-v2]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v1]❌ failure
test_albert.test_albert_token_classification_pytorch[base-v2]❌ failure
test_bert.test_bert_masked_lm_pytorch[bert-base-uncased]❌ failure
test_efficientnet.test_efficientnet_timm[efficientnet_b0]❌ failure
test_ghostnet.test_ghostnet_timm[ghostnet_100]❌ failure
test_llama_self_attn.test_llama_self_attn[openlm-research/open_llama_3b]❌ failure

Copy link
Contributor

@nvukobratTT nvukobratTT left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. And I agree, we should restructure these once we complete with initial cleanup and uplift.

Also, you have one minor issue with the updated location of construct_pre_node_map. Issues is rather trivial, so I'm still approving this PR so you can merge it once it's resolved.

Also, make sure to run nightly tests to confirm if there aren't some strange regressions coming out of this change.

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests616 ran484 passed132 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests616 ran484 passed132 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran538 passed137 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran538 passed137 skipped0 failed
TestResult
No test annotations available

@vkovinicTT
Copy link
Member Author

Looks good. And I agree, we should restructure these once we complete with initial cleanup and uplift.

Also, you have one minor issue with the updated location of construct_pre_node_map. Issues is rather trivial, so I'm still approving this PR so you can merge it once it's resolved.

Also, make sure to run nightly tests to confirm if there aren't some strange regressions coming out of this change.

I've fixed the problem with construct_pre_node_map. After running the nightly tests, some have failed but not because of the TVM changes that I have introduced.

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests616 ran484 passed132 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests616 ran484 passed132 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran538 passed137 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran538 passed137 skipped0 failed
TestResult
No test annotations available

@vkovinicTT vkovinicTT merged commit 0bf42b0 into main Feb 27, 2025
10 checks passed
@vkovinicTT vkovinicTT deleted the vkovinic/tvm_cleanup branch February 27, 2025 09:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants