.github/workflows/batch-experiment.yaml #26
jbedichekTTAnnotations
4 errors and 72 notices
|
model-tests (2)
The job running on runner tt-metal-pytorch-vm-n300-7 has exceeded the maximum execution time of 360 minutes.
|
|
model-tests (2)
The operation was canceled.
|
|
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
|
|
model-tests (2)
Process completed with exit code 1.
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 39 %
|
|
disk-usage-after-startup
Disk usage is 39 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 20 %
|
|
disk-usage-after-startup
Disk usage is 20 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 27 %
|
|
disk-usage-after-startup
Disk usage is 27 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|