Skip to content
CI

Temporarily disable 2-node tests #3810

Sign in to view logs

Temporarily disable 2-node tests

Temporarily disable 2-node tests #3810

Triggered via pull request February 6, 2025 08:06
@oluptonolupton
synchronize #1289
olupton/disable-doomed-tests
Status Startup failure
Total duration –
Artifacts –

ci.yaml

on: pull_request
metadata
metadata
bump-manifest
bump-manifest
Matrix: amd64 / test-distribution
Waiting for pending jobs
Matrix: arm64 / test-distribution
Waiting for pending jobs
amd64  /  ...  /  build-base
amd64 / build-base / build-base
arm64  /  ...  /  build-base
arm64 / build-base / build-base
amd64  /  ...  /  build
amd64 / build-jax / build
arm64  /  ...  /  build
arm64 / build-jax / build
amd64  /  ...  /  build
amd64 / build-upstream-pax / build
Matrix: amd64 / test-jax / run-unit-test
Waiting for pending jobs
amd64  /  ...  /  build
amd64 / build-upstream-t5x / build
amd64  /  ...  /  launch-slurm-runner
amd64 / test-jax / runner / launch-slurm-runner
amd64  /  test-nsys-jax-eks
amd64 / test-nsys-jax-eks
amd64  /  ...  /  build
amd64 / build-gemma / build
amd64  /  ...  /  build
amd64 / build-levanter / build
amd64  /  ...  /  build
amd64 / build-maxtext / build
amd64  /  ...  /  build
amd64 / build-triton / build
Matrix: amd64 / test-nsys-jax / run-unit-test
Waiting for pending jobs
amd64  /  ...  /  build
amd64 / build-equinox / build
amd64  /  ...  /  launch-slurm-runner
amd64 / test-nsys-jax / runner / launch-slurm-runner
arm64  /  ...  /  build
arm64 / build-upstream-pax / build
Matrix: arm64 / test-jax / run-unit-test
Waiting for pending jobs
arm64  /  ...  /  build
arm64 / build-upstream-t5x / build
arm64  /  ...  /  launch-slurm-runner
arm64 / test-jax / runner / launch-slurm-runner
arm64  /  test-nsys-jax-eks
arm64 / test-nsys-jax-eks
arm64  /  ...  /  build
arm64 / build-gemma / build
arm64  /  ...  /  build
arm64 / build-levanter / build
arm64  /  ...  /  build
arm64 / build-maxtext / build
arm64  /  ...  /  build
arm64 / build-triton / build
Matrix: arm64 / test-nsys-jax / run-unit-test
Waiting for pending jobs
arm64  /  ...  /  build
arm64 / build-equinox / build
arm64  /  ...  /  launch-slurm-runner
arm64 / test-nsys-jax / runner / launch-slurm-runner
amd64  /  ...  /  build-rosetta
amd64 / build-rosetta-pax / build-rosetta
Matrix: amd64 / test-te / run-unit-test
Waiting for pending jobs
amd64  /  ...  /  launch-slurm-runner
amd64 / test-te / runner / launch-slurm-runner
Matrix: amd64 / test-upstream-pax / pax-multi-node
Waiting for pending jobs
Matrix: amd64 / test-upstream-pax / single-process-evaluation
Waiting for pending jobs
Matrix: amd64 / test-upstream-pax / single-process-multi-device
Waiting for pending jobs
Matrix: amd64 / test-te-multigpu / te-multi-gpu
Waiting for pending jobs
amd64  /  ...  /  build-rosetta
amd64 / build-rosetta-t5x / build-rosetta
Matrix: amd64 / test-upstream-t5x / t5x-multi-gpu
Waiting for pending jobs
Matrix: amd64 / test-upstream-t5x / t5x-multi-node
Waiting for pending jobs
Matrix: amd64 / test-gemma / run-unit-test
Waiting for pending jobs
amd64  /  ...  /  launch-slurm-runner
amd64 / test-gemma / runner / launch-slurm-runner
Matrix: amd64 / test-levanter / run-unit-test
Waiting for pending jobs
amd64  /  ...  /  launch-slurm-runner
amd64 / test-levanter / runner / launch-slurm-runner
Matrix: amd64 / test-maxtext / maxtext-multinode
Waiting for pending jobs
Matrix: amd64 / test-maxtext / single-process-multi-device
Waiting for pending jobs
Matrix: amd64 / test-triton / run-unit-test
Waiting for pending jobs
amd64  /  ...  /  launch-slurm-runner
amd64 / test-triton / runner / launch-slurm-runner
Matrix: amd64 / test-nsys-jax-archive
Waiting for pending jobs
arm64  /  ...  /  build-rosetta
arm64 / build-rosetta-pax / build-rosetta
Matrix: arm64 / test-te / run-unit-test
Waiting for pending jobs
arm64  /  ...  /  launch-slurm-runner
arm64 / test-te / runner / launch-slurm-runner
Matrix: arm64 / test-upstream-pax / pax-multi-node
Waiting for pending jobs
Matrix: arm64 / test-upstream-pax / single-process-evaluation
Waiting for pending jobs
Matrix: arm64 / test-upstream-pax / single-process-multi-device
Waiting for pending jobs
Matrix: arm64 / test-te-multigpu / te-multi-gpu
Waiting for pending jobs
arm64  /  ...  /  build-rosetta
arm64 / build-rosetta-t5x / build-rosetta
Matrix: arm64 / test-upstream-t5x / t5x-multi-gpu
Waiting for pending jobs
Matrix: arm64 / test-upstream-t5x / t5x-multi-node
Waiting for pending jobs
Matrix: arm64 / test-gemma / run-unit-test
Waiting for pending jobs
arm64  /  ...  /  launch-slurm-runner
arm64 / test-gemma / runner / launch-slurm-runner
Matrix: arm64 / test-levanter / run-unit-test
Waiting for pending jobs
arm64  /  ...  /  launch-slurm-runner
arm64 / test-levanter / runner / launch-slurm-runner
Matrix: arm64 / test-maxtext / maxtext-multinode
Waiting for pending jobs
Matrix: arm64 / test-maxtext / single-process-multi-device
Waiting for pending jobs
Matrix: arm64 / test-triton / run-unit-test
Waiting for pending jobs
arm64  /  ...  /  launch-slurm-runner
arm64 / test-triton / runner / launch-slurm-runner
Matrix: arm64 / test-nsys-jax-archive
Waiting for pending jobs
Matrix: amd64 / test-rosetta-pax / rosetta-pax-multi-node-te
Waiting for pending jobs
Matrix: amd64 / test-rosetta-pax / rosetta-pax-multi-node
Waiting for pending jobs
Matrix: amd64 / test-rosetta-pax / rosetta-pax-single-node-dropout-te
Waiting for pending jobs
Matrix: amd64 / test-rosetta-pax / single-process-evaluation-te
Waiting for pending jobs
Matrix: amd64 / test-rosetta-pax / single-process-multi-device-te
Waiting for pending jobs
amd64  /  ...  /  test-upstream-pax-summary
amd64 / test-upstream-pax / test-upstream-pax-summary
amd64  /  ...  /  test-upstream-pax-metrics
amd64 / test-upstream-pax / test-upstream-pax-metrics
amd64  /  ...  /  sitrep
amd64 / test-te-multigpu / sitrep
amd64  /  collect-docker-tags
amd64 / collect-docker-tags
Matrix: amd64 / test-rosetta-t5x / multi-gpu-multi-node
Waiting for pending jobs
Matrix: amd64 / test-rosetta-t5x / single-process-multi-device
Waiting for pending jobs
Matrix: amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node
Waiting for pending jobs
Matrix: amd64 / test-rosetta-t5x / vit-single-process-multi-device
Waiting for pending jobs
amd64  /  ...  /  test-upstream-t5x-summary
amd64 / test-upstream-t5x / test-upstream-t5x-summary
amd64  /  ...  /  test-upstream-t5x-metrics
amd64 / test-upstream-t5x / test-upstream-t5x-metrics
amd64  /  ...  /  test-maxtext-summary
amd64 / test-maxtext / test-maxtext-summary
amd64  /  ...  /  test-maxtext-metrics
amd64 / test-maxtext / test-maxtext-metrics
Matrix: arm64 / test-rosetta-pax / rosetta-pax-multi-node-te
Waiting for pending jobs
Matrix: arm64 / test-rosetta-pax / rosetta-pax-multi-node
Waiting for pending jobs
Matrix: arm64 / test-rosetta-pax / rosetta-pax-single-node-dropout-te
Waiting for pending jobs
Matrix: arm64 / test-rosetta-pax / single-process-evaluation-te
Waiting for pending jobs
Matrix: arm64 / test-rosetta-pax / single-process-multi-device-te
Waiting for pending jobs
arm64  /  ...  /  test-upstream-pax-summary
arm64 / test-upstream-pax / test-upstream-pax-summary
arm64  /  ...  /  test-upstream-pax-metrics
arm64 / test-upstream-pax / test-upstream-pax-metrics
arm64  /  ...  /  sitrep
arm64 / test-te-multigpu / sitrep
arm64  /  collect-docker-tags
arm64 / collect-docker-tags
Matrix: arm64 / test-rosetta-t5x / multi-gpu-multi-node
Waiting for pending jobs
Matrix: arm64 / test-rosetta-t5x / single-process-multi-device
Waiting for pending jobs
Matrix: arm64 / test-rosetta-t5x / vit-multi-gpu-multi-node
Waiting for pending jobs
Matrix: arm64 / test-rosetta-t5x / vit-single-process-multi-device
Waiting for pending jobs
arm64  /  ...  /  test-upstream-t5x-summary
arm64 / test-upstream-t5x / test-upstream-t5x-summary
arm64  /  ...  /  test-upstream-t5x-metrics
arm64 / test-upstream-t5x / test-upstream-t5x-metrics
arm64  /  ...  /  test-maxtext-summary
arm64 / test-maxtext / test-maxtext-summary
arm64  /  ...  /  test-maxtext-metrics
arm64 / test-maxtext / test-maxtext-metrics
amd64  /  ...  /  test-pax-rosetta-summary
amd64 / test-rosetta-pax / test-pax-rosetta-summary
amd64  /  ...  /  test-pax-rosetta-metrics
amd64 / test-rosetta-pax / test-pax-rosetta-metrics
amd64  /  ...  /  sitrep
amd64 / test-upstream-pax / test-upstream-pax-sitrep / sitrep
amd64  /  ...  /  test-t5x-rosetta-summary
amd64 / test-rosetta-t5x / test-t5x-rosetta-summary
amd64  /  ...  /  test-t5x-rosetta-metrics
amd64 / test-rosetta-t5x / test-t5x-rosetta-metrics
amd64  /  ...  /  sitrep
amd64 / test-upstream-t5x / test-upstream-t5x-sitrep / sitrep
amd64  /  ...  /  sitrep
amd64 / test-maxtext / test-maxtext-sitrep / sitrep
arm64  /  ...  /  test-pax-rosetta-summary
arm64 / test-rosetta-pax / test-pax-rosetta-summary
arm64  /  ...  /  test-pax-rosetta-metrics
arm64 / test-rosetta-pax / test-pax-rosetta-metrics
arm64  /  ...  /  sitrep
arm64 / test-upstream-pax / test-upstream-pax-sitrep / sitrep
arm64  /  ...  /  test-t5x-rosetta-summary
arm64 / test-rosetta-t5x / test-t5x-rosetta-summary
arm64  /  ...  /  test-t5x-rosetta-metrics
arm64 / test-rosetta-t5x / test-t5x-rosetta-metrics
arm64  /  ...  /  sitrep
arm64 / test-upstream-t5x / test-upstream-t5x-sitrep / sitrep
arm64  /  ...  /  sitrep
arm64 / test-maxtext / test-maxtext-sitrep / sitrep
amd64  /  ...  /  sitrep
amd64 / test-rosetta-pax / test-pax-rosetta-sitrep / sitrep
amd64  /  ...  /  test-upstream-pax-outcome
amd64 / test-upstream-pax / test-upstream-pax-outcome
amd64  /  ...  /  sitrep
amd64 / test-rosetta-t5x / test-t5x-rosetta-sitrep / sitrep
amd64  /  ...  /  test-upstream-t5x-outcome
amd64 / test-upstream-t5x / test-upstream-t5x-outcome
amd64  /  ...  /  test-maxtext-outcome
amd64 / test-maxtext / test-maxtext-outcome
arm64  /  ...  /  sitrep
arm64 / test-rosetta-pax / test-pax-rosetta-sitrep / sitrep
arm64  /  ...  /  test-upstream-pax-outcome
arm64 / test-upstream-pax / test-upstream-pax-outcome
arm64  /  ...  /  sitrep
arm64 / test-rosetta-t5x / test-t5x-rosetta-sitrep / sitrep
arm64  /  ...  /  test-upstream-t5x-outcome
arm64 / test-upstream-t5x / test-upstream-t5x-outcome
arm64  /  ...  /  test-maxtext-outcome
arm64 / test-maxtext / test-maxtext-outcome
amd64  /  ...  /  test-pax-rosetta-outcome
amd64 / test-rosetta-pax / test-pax-rosetta-outcome
amd64  /  ...  /  test-t5x-rosetta-outcome
amd64 / test-rosetta-t5x / test-t5x-rosetta-outcome
arm64  /  ...  /  test-pax-rosetta-outcome
arm64 / test-rosetta-pax / test-pax-rosetta-outcome
arm64  /  ...  /  test-t5x-rosetta-outcome
arm64 / test-rosetta-t5x / test-t5x-rosetta-outcome
make-publish-configs
make-publish-configs
merge-new-manifest
merge-new-manifest
Matrix: publish-containers
Waiting for pending jobs
finalize  /  workflow-badge
finalize / workflow-badge
finalize  /  report
finalize / report
finalize  /  upload-badge
finalize / upload-badge
finalize  /  publish-badge
finalize / publish-badge
Fit to window
Zoom out
Zoom in

Annotations

1 error
Invalid workflow file: .github/workflows/ci.yaml#L550
The workflow is not valid. In NVIDIA/JAX-Toolbox/.github/workflows/_ci.yaml@cb24e2b8e3d783fc75864f6e11e559a207790b9a (Line: 550, Col: 11): Error from called workflow NVIDIA/JAX-Toolbox/.github/workflows/_test_upstream_t5x.yaml@cb24e2b8e3d783fc75864f6e11e559a207790b9a (Line: 175, Col: 15): Matrix must define at least one vector