Skip to content

(Single-card) Tests for new models #193

(Single-card) Tests for new models

(Single-card) Tests for new models #193

Manually triggered February 12, 2025 01:20
Status Failure
Total duration 2h 47m 57s
Artifacts 34

full-new-models-suite.yaml

on: workflow_dispatch
build-artifact-profiler  /  ...  /  check-docker-images
9s
build-artifact-profiler / build-docker-image / check-docker-images
build-artifact  /  ...  /  check-docker-images
8s
build-artifact / build-docker-image / check-docker-images
build-artifact-profiler  /  ...  /  🐳️ Build image
0s
build-artifact-profiler / build-docker-image / 🐳️ Build image
build-artifact  /  ...  /  🐳️ Build image
0s
build-artifact / build-docker-image / 🐳️ Build image
build-artifact-profiler  /  🛠️ Build Release ubuntu 20.04
4m 7s
build-artifact-profiler / 🛠️ Build Release ubuntu 20.04
build-artifact  /  🛠️ Build Release ubuntu 20.04
3m 14s
build-artifact / 🛠️ Build Release ubuntu 20.04
Matrix: device-perf-single-card / device-perf
Matrix: demos-single-card / single-card-demo-tests
Matrix: e2e-model-perf-single-card / models-perf
Matrix: nightly-single-card / fd-nightly
Matrix: nightly-single-card / nightly-wh-models
Matrix: nightly-single-card / nightly-wh-unstable-models
Fit to window
Zoom out
Zoom in

Annotations

3 errors, 12 warnings, and 202 notices
e2e-model-perf-single-card / llm_javelin GS
Process completed with exit code 1.
e2e-model-perf-single-card / llm_javelin GS
Process completed with exit code 2.
demos-single-card / N300_performance
Process completed with exit code 1.
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
disk-usage-greater-than-90-startup
Disk usage is high. Will try pruning stuff.
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
printing-out-smi-info-cleanup
Touching and printing out SMI info
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 48 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 64 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 66 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 89 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
disk-usage-after-startup
Disk usage is 47 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 49 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 76 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 41 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 68 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 64 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 69 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 53 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 78 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 80 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 57 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 76 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 42 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
disk-usage-after-startup
Disk usage is 51 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-setup-success-startup
Hugepages is now setup.
disk-usage-after-startup
Disk usage is 49 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 53 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
disk-usage-after-startup
Disk usage is 47 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 58 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 81 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 81 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
disk-usage-after-startup
Disk usage is 48 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 66 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 47 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 69 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 78 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 67 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
printing-out-smi-info-cleanup
Touching and printing out SMI info
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 67 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 67 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.

Artifacts

Produced during runtime
Name Size
TTMetal_build_any
174 MB
TTMetal_build_any_profiler
179 MB
device-perf-report-csv-grayskull-bare_metal
1.17 KB
device-perf-report-csv-wormhole_b0-bare_metal
1.37 KB
perf-report-csv-cnn_javelin-grayskull-bare_metal
333 Bytes
perf-report-csv-cnn_javelin-wormhole_b0-bare_metal
533 Bytes
perf-report-csv-llm_javelin-wormhole_b0-bare_metal
1.17 KB
perf-report-csv-other-grayskull-bare_metal
1.26 KB
perf-report-csv-other-wormhole_b0-bare_metal
882 Bytes
test_reports_0b04b8fc-6544-4a49-b6a0-2ed5df0ea981
634 Bytes
test_reports_15ac62e8-6a86-4bb1-b64d-6c1be490ffc7
1.32 KB
test_reports_2464c1d0-0cfb-4c0b-b36e-e69e97ba6903
731 Bytes
test_reports_2b476d38-c4a4-4cd4-b2b2-756b67cf14d7
478 Bytes
test_reports_36617571-c56a-42f3-865c-deebbd157758
1.38 KB
test_reports_3d3ed347-700f-4a56-b719-c9e798912917
430 Bytes
test_reports_42b35c95-d479-4bba-821d-8165b8d6fc28
613 Bytes
test_reports_42c41f79-7076-4176-9cc3-e21273e02cfc
431 Bytes
test_reports_49b05612-9ec1-471f-b2c2-e3a49edf784e
622 Bytes
test_reports_7f3c75f1-08d7-4f29-aeb3-e6c3f0f9bc12
630 Bytes
test_reports_83e45bfa-2554-4d85-86f1-dc1737a5cb7f
1.32 KB
test_reports_858b373b-1158-475e-8a65-ec85f9642b0f
479 Bytes
test_reports_96fb1b6c-4ebd-466f-a368-e679d9ec1ba3
546 Bytes
test_reports_9bb54ec9-78d9-4acc-b490-613c04449323
1.12 KB
test_reports_9ecd871e-fb23-486f-a302-6af754396bbf
1.24 KB
test_reports_b5e48341-7a95-4ebc-b3e1-2ff58cda0890
550 Bytes
test_reports_be2190f4-bc0b-44fe-a8d4-f72d45db0c43
4 KB
test_reports_c0cd0810-8abd-4ba8-8e4c-cdd52ba168f2
731 Bytes
test_reports_c5988c5e-7d15-4949-8615-7da8ce8cc2e2
621 Bytes
test_reports_c9dd102f-520b-403e-ba9e-6ca655378503
610 Bytes
test_reports_ee1cf11a-8fc1-44e6-930c-d1db6aaab6df
6.51 KB
test_reports_f004fe80-436c-4fd0-8ade-181adeb04d07
3.98 KB
test_reports_f122d80b-ba05-47e2-b7a2-779e2d7aca97
6.42 KB
test_reports_f187e1b9-ea33-4f76-8d2e-b80332f07356
6.89 KB
test_reports_fddc1e4d-6939-42d8-8bd9-7d3daeab60db
480 Bytes