test_line_all_gather_sharded_on_TG_cols_post_commit[wormhole_b0-True-8x4_grid-True-4-tensor_mem_layout4-input_shape4-0-input_shard_shape4-shard_grid4-layout4-shard_grid_orientation0-input_dtype0-8-1] AssertionError: FAILED: Max ATOL Delta: 0.99609375, Max RTOL Delta: nan, PCC: 0.015744418078162646, Equal check failed assert False

test_line_all_gather_sharded_on_TG_cols_post_commit[wormhole_b0-True-8x4_grid-True-4-tensor_mem_layout4-input_shape4-0-input_shard_shape4-shard_grid4-layout4-shard_grid_orientation0-input_dtype1-8-1] AssertionError: FAILED: Max ATOL Delta: 0.99609375, Max RTOL Delta: nan, PCC: 0.01574375583095346, PCC check failed assert False

test_line_all_gather_sharded_on_TG_cols_post_commit[wormhole_b0-True-8x4_grid-True-4-tensor_mem_layout5-input_shape5-1-input_shard_shape5-shard_grid5-layout5-shard_grid_orientation0-input_dtype0-8-1] AssertionError: FAILED: Max ATOL Delta: 0.99609375, Max RTOL Delta: nan, PCC: 0.014854829444581124, Equal check failed assert False

test_line_all_gather_sharded_on_TG_cols_post_commit[wormhole_b0-True-8x4_grid-True-4-tensor_mem_layout5-input_shape5-1-input_shard_shape5-shard_grid5-layout5-shard_grid_orientation0-input_dtype1-8-1] AssertionError: FAILED: Max ATOL Delta: 0.99609375, Max RTOL Delta: nan, PCC: 0.01485331214932193, PCC check failed assert False

test_line_all_gather_sharded_on_TG_cols_post_commit[wormhole_b0-True-8x4_grid-True-4-tensor_mem_layout6-input_shape6-2-input_shard_shape6-shard_grid6-layout6-shard_grid_orientation0-input_dtype0-8-1] AssertionError: FAILED: Max ATOL Delta: 0.99609375, Max RTOL Delta: nan, PCC: 0.014854829444581124, Equal check failed assert False

test_line_all_gather_sharded_on_TG_cols_post_commit[wormhole_b0-True-8x4_grid-True-4-tensor_mem_layout6-input_shape6-2-input_shard_shape6-shard_grid6-layout6-shard_grid_orientation0-input_dtype1-8-1] AssertionError: FAILED: Max ATOL Delta: 0.99609375, Max RTOL Delta: nan, PCC: 0.01485331214932193, PCC check failed assert False

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')

Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available