ttnn - Run sweeps #2408
Triggered via schedule
February 28, 2025 21:04
jdesousa-TT
Status
Failure
Total duration
12h 35m 54s
Artifacts
2
ttnn-run-sweeps.yaml
on: schedule
build-artifact
/
...
/
check-docker-images
6s
build-artifact
/
🛠️ Build Release ubuntu 20.04
2m 59s
Matrix: ttnn-run-sweeps
Annotations
8 errors and 11 notices
|
ttnn-run-sweeps (Wormhole N300 Sweeps, wormhole_b0, cloud-virtual-machine, N300, in-service, tt-s...
The job running on runner tt-metal-ci-vm-142 has exceeded the maximum execution time of 720 minutes.
|
|
ttnn-run-sweeps (Wormhole N300 Sweeps, wormhole_b0, cloud-virtual-machine, N300, in-service, tt-s...
The operation was canceled.
|
|
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
|
|
ttnn-run-sweeps (Wormhole N300 Sweeps, wormhole_b0, cloud-virtual-machine, N300, in-service, tt-s...
Process completed with exit code 1.
|
|
ttnn-run-sweeps (Wormhole N150 Sweeps, wormhole_b0, cloud-virtual-machine, N150, in-service, tt-s...
The job running on runner tt-metal-ci-vm-27 has exceeded the maximum execution time of 720 minutes.
|
|
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
|
|
ttnn-run-sweeps (Wormhole N150 Sweeps, wormhole_b0, cloud-virtual-machine, N150, in-service, tt-s...
Process completed with exit code 1.
|
|
ttnn-run-sweeps (Wormhole N150 Sweeps, wormhole_b0, cloud-virtual-machine, N150, in-service, tt-s...
The operation was canceled.
|
|
disk-usage-after-startup
Disk usage is 42 %
|
|
disk-usage-after-startup
Disk usage is 71 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
hugepages-setup-success-startup
Hugepages is now setup.
|
|
disk-usage-after-startup
Disk usage is 74 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
hugepages-setup-success-startup
Hugepages is now setup.
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
TTMetal_build_any
|
186 MB |
|
|
packages-ubuntu-20.04-amd64-Release-x86_64-linux-clang-17-libcpp
|
89.4 MB |
|