Skip to content

.github/workflows/batch-experiment.yaml #29

.github/workflows/batch-experiment.yaml

.github/workflows/batch-experiment.yaml #29

Manually triggered February 28, 2025 19:30
Status Cancelled
Total duration 3h 17m 14s
Artifacts

batch-experiment.yaml

on: workflow_dispatch
Matrix: model-tests
Fit to window
Zoom out
Zoom in

Annotations

28 errors and 40 notices
model-tests (20)
The run was canceled by @jbedichekTT.
model-tests (3)
The run was canceled by @jbedichekTT.
model-tests (4)
The run was canceled by @jbedichekTT.
model-tests (21)
The run was canceled by @jbedichekTT.
model-tests (23)
The run was canceled by @jbedichekTT.
model-tests (7)
The run was canceled by @jbedichekTT.
model-tests (5)
The run was canceled by @jbedichekTT.
model-tests (24)
The run was canceled by @jbedichekTT.
model-tests (8)
The run was canceled by @jbedichekTT.
model-tests (6)
The run was canceled by @jbedichekTT.
model-tests (9)
The run was canceled by @jbedichekTT.
model-tests (2)
The run was canceled by @jbedichekTT.
model-tests (2)
The operation was canceled.
model-tests (12)
The run was canceled by @jbedichekTT.
model-tests (12)
The operation was canceled.
model-tests (19)
The run was canceled by @jbedichekTT.
model-tests (19)
The operation was canceled.
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
model-tests (19)
Process completed with exit code 1.
model-tests (15)
The run was canceled by @jbedichekTT.
model-tests (15)
The operation was canceled.
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
model-tests (15)
Process completed with exit code 1.
model-tests (10)
The run was canceled by @jbedichekTT.
model-tests (10)
The operation was canceled.
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
model-tests (10)
Process completed with exit code 1.
model-tests (22)
The run was canceled by @jbedichekTT.
disk-usage-before-startup
Disk usage is 19 %
disk-usage-after-startup
Disk usage is 19 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 27 %
disk-usage-after-startup
Disk usage is 27 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 19 %
disk-usage-after-startup
Disk usage is 19 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 51 %
disk-usage-after-startup
Disk usage is 51 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 19 %
disk-usage-after-startup
Disk usage is 19 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 19 %
disk-usage-after-startup
Disk usage is 19 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 38 %
disk-usage-after-startup
Disk usage is 38 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 19 %
disk-usage-after-startup
Disk usage is 19 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 20 %
disk-usage-after-startup
Disk usage is 20 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 20 %
disk-usage-after-startup
Disk usage is 20 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful