(Single-card) Tests for new models #230
full-new-models-suite.yaml
on: workflow_dispatch
build-artifact-profiler
/
...
/
check-docker-images
12s
build-artifact
/
...
/
check-docker-images
7s
build-artifact-profiler
/
...
/
🐳️ Build image
0s
build-artifact-profiler
/
🛠️ Build Release ubuntu 20.04
3m 18s
Matrix: device-perf-single-card / device-perf
Matrix: demos-single-card / single-card-demo-tests
Matrix: e2e-model-perf-single-card / models-perf
Matrix: nightly-single-card / fd-nightly
Matrix: nightly-single-card / nightly-wh-models
Matrix: nightly-single-card / nightly-wh-unstable-models
Annotations
24 errors, 135 warnings, and 172 notices
nightly-single-card / [Unstable] Nightly N150 mamba 5
Unable to locate executable file: git-lfs. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.
|
e2e-model-perf-single-card / cnn_javelin N300 WH B0
Process completed with exit code 2.
|
e2e-model-perf-single-card / cnn_javelin N300 WH B0:
models/experimental/functional_unet/tests/test_unet_perf.py#L119
test_unet_trace_perf_multi_device[wormhole_b0-True-1-2-128-25.0-1650.0-False-device_params0]
RuntimeError: bad_variant_access
|
e2e-model-perf-single-card / cnn_javelin N300 WH B0
Process completed with exit code 1.
|
nightly-single-card / Nightly N150 functional_unet:
tests/nightly/single_card/functional_unet/experimental/functional_unet/tests/test_unet_upblock.py#L71
test_unet_upblock[device_params0-upblock2-32-132-20-32-1-2]
AssertionError: 0.9989989668297883
|
nightly-single-card / Nightly N150 functional_unet:
tests/nightly/single_card/functional_unet/experimental/functional_unet/tests/test_unet_upblock.py#L71
test_unet_upblock[device_params0-upblock4-16-528-80-16-1-2]
AssertionError: 0.998989618643751
|
nightly-single-card / Nightly N150 functional_unet
Process completed with exit code 1.
|
device-perf-single-card / N300 WH B0 device perf
Process completed with exit code 2.
|
device-perf-single-card / N300 WH B0 device perf
Unable to download artifact(s): Artifact not found for name: eager-dist-ubuntu-20.04-any-profiler
Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact.
For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
|
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
|
nightly-single-card / Nightly N150 resnet50
Process completed with exit code 1.
|
nightly-single-card / Nightly N150 resnet50:
tests/nightly/single_card/resnet50/models/demos/wormhole/resnet50/tests/test_resnet50_performant.py#L46
test_run_resnet50_trace_inference[False-16-act_dtype0-weight_dtype0-math_fidelity0-device_params0]
RuntimeError: TT_FATAL @ /work/tt_metal/impl/trace/trace.cpp:46: cq.device()->get_trace_buffers_size() <= trace_region_size
info:
Creating trace buffers of size 802816B on device 0, but only 800768B is allocated for trace region.
backtrace:
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/build/lib/libtt_metal.so(+0x2a5ceb) [0x7f7b863e9ceb]
--- tt::tt_metal::v0::Trace::initialize_buffer(tt::tt_metal::CommandQueue&, std::__1::shared_ptr<tt::tt_metal::TraceBuffer> const&)
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/build/lib/libtt_metal.so(+0x1a0043) [0x7f7b862e4043]
--- tt::tt_metal::v0::Device::end_trace(unsigned char, unsigned int)
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0x2adae07) [0x7f7b891e1e07]
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0x2adad0e) [0x7f7b891e1d0e]
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0xedbd06) [0x7f7b875e2d06]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyCFunction_Call+0x6b) [0x7f7bd0061a8b]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyObject_MakeTpCall+0x170) [0x7f7bd0060d10]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x5136) [0x7f7bd00d0336]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0xfa) [0x7f7bd006145a]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x3b3) [0x7f7bd00cb5b3]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x301) [0x7f7bd00ca5e1]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f7bd00614ee]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyVectorcall_Call+0x74) [0x7f7bd00620c4]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x2370) [0x7f7bd00cd570]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8b2) [0x7f7bd00cab92]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f7bd00614ee]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyVectorcall_Call+0x74) [0x7f7bd00620c4]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x2370) [0x7f7bd00cd570]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8b2) [0x7f7bd00cab92]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f7bd00614ee]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4afc) [0x7f7bd00cfcfc]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0xfa) [0x7f7bd006145a]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(+0x1339c8) [0x7f7bd00639c8]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4afc) [0x7f7bd00cfcfc]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x301) [0x7f7bd00ca5e1]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f7bd00614ee]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyObject_FastCallDict+0x238) [0x7f7bd0060908]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(
|
nightly-single-card / Nightly N150 resnet50:
tests/nightly/single_card/resnet50/models/demos/wormhole/resnet50/tests/test_resnet50_performant.py#L87
test_run_resnet50_trace_2cqs_inference[False-16-act_dtype0-weight_dtype0-math_fidelity0-device_params0]
RuntimeError: TT_FATAL @ /work/tt_metal/impl/trace/trace.cpp:46: cq.device()->get_trace_buffers_size() <= trace_region_size
info:
Creating trace buffers of size 802816B on device 0, but only 800768B is allocated for trace region.
backtrace:
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/build/lib/libtt_metal.so(+0x2a5ceb) [0x7f4013963ceb]
--- tt::tt_metal::v0::Trace::initialize_buffer(tt::tt_metal::CommandQueue&, std::__1::shared_ptr<tt::tt_metal::TraceBuffer> const&)
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/build/lib/libtt_metal.so(+0x1a0043) [0x7f401385e043]
--- tt::tt_metal::v0::Device::end_trace(unsigned char, unsigned int)
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0x2adae07) [0x7f401675be07]
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0x2adad0e) [0x7f401675bd0e]
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0xedbd06) [0x7f4014b5cd06]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyCFunction_Call+0x6b) [0x7f405d5d8a8b]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyObject_MakeTpCall+0x170) [0x7f405d5d7d10]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x5136) [0x7f405d647336]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0xfa) [0x7f405d5d845a]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x3b3) [0x7f405d6425b3]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x301) [0x7f405d6415e1]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f405d5d84ee]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyVectorcall_Call+0x74) [0x7f405d5d90c4]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x2370) [0x7f405d644570]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8b2) [0x7f405d641b92]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f405d5d84ee]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyVectorcall_Call+0x74) [0x7f405d5d90c4]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x2370) [0x7f405d644570]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8b2) [0x7f405d641b92]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f405d5d84ee]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4afc) [0x7f405d646cfc]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0xfa) [0x7f405d5d845a]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(+0x1339c8) [0x7f405d5da9c8]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4afc) [0x7f405d646cfc]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x301) [0x7f405d6415e1]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f405d5d84ee]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyObject_FastCallDict+0x238) [0x7f405d5d7908]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so
|
nightly-single-card / Nightly N150 resnet50
The action 'Run frequent reg tests scripts' has timed out after 30 minutes.
|
nightly-single-card / Nightly N300 resnet50:
tests/nightly/single_card/resnet50/models/demos/wormhole/resnet50/tests/test_resnet50_performant.py#L46
test_run_resnet50_trace_inference[False-16-act_dtype0-weight_dtype0-math_fidelity0-device_params0]
RuntimeError: TT_FATAL @ /work/tt_metal/impl/trace/trace.cpp:46: cq.device()->get_trace_buffers_size() <= trace_region_size
info:
Creating trace buffers of size 802816B on device 0, but only 800768B is allocated for trace region.
backtrace:
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/build/lib/libtt_metal.so(+0x2a5ceb) [0x7f30ec555ceb]
--- tt::tt_metal::v0::Trace::initialize_buffer(tt::tt_metal::CommandQueue&, std::__1::shared_ptr<tt::tt_metal::TraceBuffer> const&)
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/build/lib/libtt_metal.so(+0x1a0043) [0x7f30ec450043]
--- tt::tt_metal::v0::Device::end_trace(unsigned char, unsigned int)
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0x2adae07) [0x7f30ef358e07]
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0x2adad0e) [0x7f30ef358d0e]
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0xedbd06) [0x7f30ed759d06]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyCFunction_Call+0x6b) [0x7f31311bbb5b]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyObject_MakeTpCall+0x170) [0x7f31311badf0]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x512c) [0x7f313122a59c]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0xfa) [0x7f31311bb52a]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x3b2) [0x7f3131225822]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x301) [0x7f3131224851]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f31311bb5be]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyVectorcall_Call+0x74) [0x7f31311bc194]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x2367) [0x7f31312277d7]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8b2) [0x7f3131224e02]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f31311bb5be]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyVectorcall_Call+0x74) [0x7f31311bc194]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x2367) [0x7f31312277d7]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8b2) [0x7f3131224e02]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f31311bb5be]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4a9d) [0x7f3131229f0d]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0xfa) [0x7f31311bb52a]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(+0x133a98) [0x7f31311bda98]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4a9d) [0x7f3131229f0d]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x301) [0x7f3131224851]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f31311bb5be]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyObject_FastCallDict+0x238) [0x7f31311ba9e8]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(
|
nightly-single-card / Nightly N300 resnet50:
tests/nightly/single_card/resnet50/models/demos/wormhole/resnet50/tests/test_resnet50_performant.py#L87
test_run_resnet50_trace_2cqs_inference[False-16-act_dtype0-weight_dtype0-math_fidelity0-device_params0]
RuntimeError: TT_FATAL @ /work/tt_metal/impl/trace/trace.cpp:46: cq.device()->get_trace_buffers_size() <= trace_region_size
info:
Creating trace buffers of size 802816B on device 0, but only 800768B is allocated for trace region.
backtrace:
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/build/lib/libtt_metal.so(+0x2a5ceb) [0x7f4f36288ceb]
--- tt::tt_metal::v0::Trace::initialize_buffer(tt::tt_metal::CommandQueue&, std::__1::shared_ptr<tt::tt_metal::TraceBuffer> const&)
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/build/lib/libtt_metal.so(+0x1a0043) [0x7f4f36183043]
--- tt::tt_metal::v0::Device::end_trace(unsigned char, unsigned int)
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0x2adae07) [0x7f4f3908be07]
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0x2adad0e) [0x7f4f3908bd0e]
--- /home/ubuntu/actions-runner/_work/tt-metal/tt-metal/ttnn/ttnn/_ttnn.so(+0xedbd06) [0x7f4f3748cd06]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyCFunction_Call+0x6b) [0x7f4f7aeecb5b]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyObject_MakeTpCall+0x170) [0x7f4f7aeebdf0]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x512c) [0x7f4f7af5b59c]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0xfa) [0x7f4f7aeec52a]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x3b2) [0x7f4f7af56822]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x301) [0x7f4f7af55851]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f4f7aeec5be]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyVectorcall_Call+0x74) [0x7f4f7aeed194]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x2367) [0x7f4f7af587d7]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8b2) [0x7f4f7af55e02]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f4f7aeec5be]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(PyVectorcall_Call+0x74) [0x7f4f7aeed194]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x2367) [0x7f4f7af587d7]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8b2) [0x7f4f7af55e02]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f4f7aeec5be]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4a9d) [0x7f4f7af5af0d]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0xfa) [0x7f4f7aeec52a]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(+0x133a98) [0x7f4f7aeeea98]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4a9d) [0x7f4f7af5af0d]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x301) [0x7f4f7af55851]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x18e) [0x7f4f7aeec5be]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so.1.0(_PyObject_FastCallDict+0x238) [0x7f4f7aeeb9e8]
--- /home/ubuntu/actions-runner/_work/_tool/Python/3.8.18/x64/lib/libpython3.8.so
|
nightly-single-card / Nightly N300 resnet50
The action 'Run frequent reg tests scripts' has timed out after 30 minutes.
|
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
|
nightly-single-card / Nightly N300 resnet50
Process completed with exit code 1.
|
nightly-single-card / Nightly N300 functional_unet:
tests/nightly/single_card/functional_unet/experimental/functional_unet/tests/test_unet_trace.py#L563
test_unet_trace_2cq_same_io_multi_device[wormhole_b0-True-1-2-128-device_params0-False]
RuntimeError: bad_variant_access
|
nightly-single-card / Nightly N300 functional_unet:
tests/nightly/single_card/functional_unet/experimental/functional_unet/tests/test_unet_upblock.py#L71
test_unet_upblock[device_params0-upblock2-32-132-20-32-1-2]
AssertionError: 0.9989989668297883
|
nightly-single-card / Nightly N300 functional_unet
The action 'Run frequent reg tests scripts' has timed out after 30 minutes.
|
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
|
nightly-single-card / Nightly N300 functional_unet
Process completed with exit code 1.
|
nightly-single-card / [Unstable] Nightly N300 mamba 5:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 mamba 5:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_embedding.py#L18
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_rms_norm.py#L19
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_mlp.py#L19
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_attention.py#L23
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_attention_prefill.py#L24
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_decoder.py#L23
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_decoder_prefill.py#L24
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_rms_norm.py#L19
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_mlp.py#L19
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N300 llama3.2-1B:
models/demos/llama3/tests/test_llama_attention.py#L23
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_embedding.py#L18
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_rms_norm.py#L19
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_mlp.py#L19
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_attention.py#L23
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_attention_prefill.py#L24
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_decoder.py#L23
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_decoder_prefill.py#L24
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_rms_norm.py#L19
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_mlp.py#L19
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 llama3.2-1B:
models/demos/llama3/tests/test_llama_attention.py#L23
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 common_models:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / other N300 WH B0:
models/demos/wormhole/resnet50/tests/test_perf_e2e_resnet50.py#L11
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
e2e-model-perf-single-card / other N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / other N300 WH B0:
models/demos/wormhole/resnet50/tests/test_perf_e2e_resnet50.py#L38
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
e2e-model-perf-single-card / other N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / other N300 WH B0:
models/demos/wormhole/resnet50/tests/test_perf_e2e_resnet50.py#L38
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
e2e-model-perf-single-card / other N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / other N300 WH B0:
models/demos/wormhole/resnet50/tests/test_perf_e2e_resnet50.py#L71
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
e2e-model-perf-single-card / other N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / other N300 WH B0:
models/demos/wormhole/resnet50/tests/test_perf_e2e_resnet50.py#L98
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
e2e-model-perf-single-card / other N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 functional_unet:
python_env/lib/python3.8/site-packages/_pytest/python.py#L199
Expected None, but tests/nightly/single_card/functional_unet/experimental/functional_unet/tests/test_unet_trace.py::test_unet_trace_2cq_same_io[1-2-128-device_params0] returned UNetPerformanceStatistics(groups=2, batch=1, num_devices=1, inference_and_compile_time=0.5550003051757812, inference_time=0.0023880209773778915), which will be an error in a future version of pytest. Did you mean to use `assert` instead of `return`?
|
nightly-single-card / Nightly N150 functional_unet:
python_env/lib/python3.8/site-packages/_pytest/python.py#L199
Expected None, but tests/nightly/single_card/functional_unet/experimental/functional_unet/tests/test_unet_trace.py::test_unet_trace_2cq_same_io[1-2-128-device_params0] returned UNetPerformanceStatistics(groups=2, batch=1, num_devices=1, inference_and_compile_time=0.5550003051757812, inference_time=0.0023880209773778915), which will be an error in a future version of pytest. Did you mean to use `assert` instead of `return`?
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N150 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / FD WH N300 ttnn nightly wormhole_b0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
models/demos/wormhole/stable_diffusion/custom_preprocessing.py#L32
The use of `x.T` on tensors of dimension other than 2 to reverse their shape is deprecated and it will throw an error in a future release. Consider `x.mT` to transpose batches of matrices or `x.permute(*torch.arange(x.ndim - 1, -1, -1))` to reverse the dimensions of a tensor. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3637.)
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N150 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / llm_javelin N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / llm_javelin N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / llm_javelin N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / llm_javelin N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / llm_javelin N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
e2e-model-perf-single-card / llm_javelin N300 WH B0:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
models/demos/wormhole/stable_diffusion/custom_preprocessing.py#L32
The use of `x.T` on tensors of dimension other than 2 to reverse their shape is deprecated and it will throw an error in a future release. Consider `x.mT` to transpose batches of matrices or `x.permute(*torch.arange(x.ndim - 1, -1, -1))` to reverse the dimensions of a tensor. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3637.)
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / [Unstable] Nightly N300 stable_diffusion:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
nightly-single-card / Nightly N150 resnet50
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
|
nightly-single-card / Nightly N300 resnet50
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
|
nightly-single-card / Nightly N300 functional_unet
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
|
nightly-single-card / Nightly N300 functional_unet:
python_env/lib/python3.8/site-packages/_pytest/python.py#L199
Expected None, but tests/nightly/single_card/functional_unet/experimental/functional_unet/tests/test_unet_trace.py::test_unet_trace_2cq_same_io[1-2-128-device_params0] returned UNetPerformanceStatistics(groups=2, batch=1, num_devices=1, inference_and_compile_time=0.5397968292236328, inference_time=0.0023779403418302536), which will be an error in a future version of pytest. Did you mean to use `assert` instead of `return`?
|
nightly-single-card / Nightly N300 functional_unet:
python_env/lib/python3.8/site-packages/_pytest/python.py#L199
Expected None, but tests/nightly/single_card/functional_unet/experimental/functional_unet/tests/test_unet_trace.py::test_unet_trace_2cq_same_io[1-2-128-device_params0] returned UNetPerformanceStatistics(groups=2, batch=1, num_devices=1, inference_and_compile_time=0.5397968292236328, inference_time=0.0023779403418302536), which will be an error in a future version of pytest. Did you mean to use `assert` instead of `return`?
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N300_functionality:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L548
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L548
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L548
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L548
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L548
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L548
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L89
To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L100
To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L548
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
demos-single-card / N300_performance:
models/demos/wormhole/mistral7b/demo/demo_with_prefill.py#L548
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
demos-single-card / N150:
python_env/lib/python3.8/site-packages/transformers/generation/utils.py#L4811
`top_k_top_p_filtering` is scheduled for deletion in v4.39. Use `TopKLogitsWarper` and `TopPLogitsWarper` instead.
|
disk-usage-after-startup
Disk usage is 60 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 61 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 62 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 71 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 70 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 68 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 59 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 53 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 69 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 81 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 69 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 48 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 69 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 80 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 72 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 74 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 82 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 78 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 80 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 74 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 59 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
disk-usage-after-startup
Disk usage is 60 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 36 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 78 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 59 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 53 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 77 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 74 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
disk-usage-after-startup
Disk usage is 78 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
hugepages-setup-success-startup
Hugepages is now setup.
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
TTMetal_build_any
|
185 MB |
|
TTMetal_build_any_profiler
|
190 MB |
|
packages-ubuntu-20.04-amd64-Release-x86_64-linux-clang-17-libcpp
|
89.3 MB |
|
packages-ubuntu-20.04-amd64-Release-x86_64-linux-clang-17-libcpp_profiler
|
89.4 MB |
|
perf-report-csv-llm_javelin-wormhole_b0-bare_metal
|
1.21 KB |
|
perf-report-csv-other-wormhole_b0-bare_metal
|
908 Bytes |
|
test_reports_22dbfa9e-5113-4a50-b71e-ca50dca9332c
|
735 Bytes |
|
test_reports_40b9375f-6a7e-45b6-92ef-570cf0f3b966
|
6.51 KB |
|
test_reports_4a2650eb-d666-419b-bb70-3f26302c7d05
|
1.32 KB |
|
test_reports_5a1dcef0-79c8-4275-b63c-8ef5d1d4acd4
|
430 Bytes |
|
test_reports_5ada4f5d-45dd-478f-8c58-5ca9243650df
|
4.01 KB |
|
test_reports_6cca8c74-4c10-49d3-bd21-09fd0bee7181
|
621 Bytes |
|
test_reports_6f66e0cb-496d-4bc5-82a3-18c751a911ab
|
1.31 KB |
|
test_reports_87f6ab2a-cab9-4d1e-a700-7b19d88e3591
|
619 Bytes |
|
test_reports_a05d6986-9ddb-4cc4-84a5-dcb7cc5c287d
|
478 Bytes |
|
test_reports_b1e843ef-0ef9-4fee-872e-fd1763284a48
|
548 Bytes |
|
test_reports_bf8466ec-56bb-461d-9681-a7ba4e25ade8
|
6.46 KB |
|
test_reports_c1e6e366-0af7-4d70-a571-f8b0541abf71
|
2.53 KB |
|
test_reports_ccc2d24b-6eb4-420a-b0b5-0f3d417515e6
|
478 Bytes |
|
test_reports_d003d50c-1d49-4d1a-943e-49204cfb88b9
|
731 Bytes |
|
test_reports_d1e31482-7da7-40f4-9f8f-f6cf42e753ab
|
4.01 KB |
|
test_reports_e0afc1e9-ffbd-41a7-a6dd-8ea1d0a69334
|
428 Bytes |
|
test_reports_e4433a98-d9ae-4034-b490-2cba35628e87
|
553 Bytes |
|
test_reports_ea5a8e3d-37f6-4258-abca-1f5c5f9fdf1d
|
431 Bytes |
|
test_reports_f1739cce-ca20-46e7-8d18-4d8628183e5a
|
626 Bytes |
|