Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sync changes from develop #3278

Merged

merge develop

42d35eb
Select commit
Loading
Failed to load commit list.
Merged

Sync changes from develop #3278

merge develop
42d35eb
Select commit
Loading
Failed to load commit list.
Google Cloud Build / PR-validation (hpc-toolkit-dev) failed Nov 18, 2024 in 2m 43s

Summary

Build Information

Trigger PR-validation
Build ce6b50d9-20a2-4fdc-8bee-78fa62da5dcd
Start 2024-11-18T13:04:10-08:00
Duration 1m56.29s
Status FAILURE

Steps

Step Status Duration
git-fetch-unshallow SUCCESS 3.731s
make-tests FAILURE 1m48.323s

Details

starting build "ce6b50d9-20a2-4fdc-8bee-78fa62da5dcd"

FETCHSOURCE
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint:
hint: 	git config --global init.defaultBranch <name>
hint:
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint:
hint: 	git branch -m <name>
Initialized empty Git repository in /workspace/.git/
From https://github.com/GoogleCloudPlatform/cluster-toolkit
 * branch            42d35eba85f233006f8d581292570a5f8b7e7ee4 -> FETCH_HEAD
HEAD is now at 42d35eb merge develop
SETUPBUILD
BUILD
Starting Step #0 - "git-fetch-unshallow"
Step #0 - "git-fetch-unshallow": Already have image (with digest): gcr.io/cloud-builders/git
Step #0 - "git-fetch-unshallow": From https://github.com/GoogleCloudPlatform/cluster-toolkit
Step #0 - "git-fetch-unshallow":  * [new branch]        chdu                -> origin/chdu
Step #0 - "git-fetch-unshallow":  * [new branch]        develop             -> origin/develop
Step #0 - "git-fetch-unshallow":  * [new branch]        experimental        -> origin/experimental
Step #0 - "git-fetch-unshallow":  * [new branch]        main                -> origin/main
Step #0 - "git-fetch-unshallow":  * [new branch]        release-candidate   -> origin/release-candidate
Step #0 - "git-fetch-unshallow":  * [new branch]        revert-3232-develop -> origin/revert-3232-develop
Step #0 - "git-fetch-unshallow":  * [new branch]        revert-3260-experimental-kueue -> origin/revert-3260-experimental-kueue
Step #0 - "git-fetch-unshallow":  * [new branch]        sc23                -> origin/sc23
Step #0 - "git-fetch-unshallow":  * [new branch]        version/v1.42.0     -> origin/version/v1.42.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.41.0             -> v1.41.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.1.0-alpha        -> v0.1.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.1.1-alpha        -> v0.1.1-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.2.0-alpha        -> v0.2.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.2.1-alpha        -> v0.2.1-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.2.2-alpha        -> v0.2.2-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.3.0-alpha        -> v0.3.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.3.1-alpha        -> v0.3.1-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.4.0-alpha        -> v0.4.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.5.0-alpha        -> v0.5.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.6.0-alpha        -> v0.6.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.7.0-alpha        -> v0.7.0-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.7.1-alpha        -> v0.7.1-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v0.7.2-alpha        -> v0.7.2-alpha
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.0.0              -> v1.0.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.1.0              -> v1.1.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.10.0             -> v1.10.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.10.1             -> v1.10.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.11.0             -> v1.11.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.12.0             -> v1.12.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.13.0             -> v1.13.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.14.0             -> v1.14.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.14.1             -> v1.14.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.15.0             -> v1.15.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.16.0             -> v1.16.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.17.0             -> v1.17.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.18.0             -> v1.18.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.18.1             -> v1.18.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.19.0             -> v1.19.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.19.1             -> v1.19.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.2.0              -> v1.2.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.2.1              -> v1.2.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.20.0             -> v1.20.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.21.0             -> v1.21.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.22.0             -> v1.22.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.22.1             -> v1.22.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.23.0             -> v1.23.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.24.0             -> v1.24.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.25.0             -> v1.25.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.26.0             -> v1.26.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.26.1             -> v1.26.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.27.0             -> v1.27.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.28.1             -> v1.28.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.29.0             -> v1.29.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.3.0              -> v1.3.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.30.0             -> v1.30.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.31.0             -> v1.31.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.31.1             -> v1.31.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.32.0             -> v1.32.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.32.1             -> v1.32.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.33.0             -> v1.33.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.34.0             -> v1.34.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.34.1             -> v1.34.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.34.2             -> v1.34.2
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.34.3             -> v1.34.3
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.35.0             -> v1.35.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.35.1             -> v1.35.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.36.0             -> v1.36.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.36.1             -> v1.36.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.37.0             -> v1.37.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.37.1             -> v1.37.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.37.2             -> v1.37.2
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.38.0             -> v1.38.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.39.0             -> v1.39.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.4.0              -> v1.4.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.4.1              -> v1.4.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.40.0             -> v1.40.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.40.1             -> v1.40.1
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.5.0              -> v1.5.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.6.0              -> v1.6.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.7.0              -> v1.7.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.8.0              -> v1.8.0
Step #0 - "git-fetch-unshallow":  * [new tag]           v1.9.0              -> v1.9.0
Finished Step #0 - "git-fetch-unshallow"
Starting Step #1 - "make-tests"
Step #1 - "make-tests": Pulling image: us-central1-docker.pkg.dev/hpc-toolkit-dev/hpc-toolkit-repo/test-runner
Step #1 - "make-tests": Using default tag: latest
Step #1 - "make-tests": latest: Pulling from hpc-toolkit-dev/hpc-toolkit-repo/test-runner
Step #1 - "make-tests": c2056d933cd6: Pulling fs layer
Step #1 - "make-tests": d3f895247ac5: Pulling fs layer
Step #1 - "make-tests": 05d199724b11: Pulling fs layer
Step #1 - "make-tests": 34766222467c: Pulling fs layer
Step #1 - "make-tests": c79bddf330f7: Pulling fs layer
Step #1 - "make-tests": 55b755dce003: Pulling fs layer
Step #1 - "make-tests": 4f4fb700ef54: Pulling fs layer
Step #1 - "make-tests": 3b7e397d0b33: Pulling fs layer
Step #1 - "make-tests": 7e08c6ffd97f: Pulling fs layer
Step #1 - "make-tests": 3b7e397d0b33: Waiting
Step #1 - "make-tests": 7e08c6ffd97f: Waiting
Step #1 - "make-tests": 4f4fb700ef54: Waiting
Step #1 - "make-tests": c79bddf330f7: Waiting
Step #1 - "make-tests": 55b755dce003: Waiting
Step #1 - "make-tests": d3f895247ac5: Verifying Checksum
Step #1 - "make-tests": d3f895247ac5: Download complete
Step #1 - "make-tests": 05d199724b11: Verifying Checksum
Step #1 - "make-tests": 05d199724b11: Download complete
Step #1 - "make-tests": c2056d933cd6: Verifying Checksum
Step #1 - "make-tests": c2056d933cd6: Download complete
Step #1 - "make-tests": 55b755dce003: Verifying Checksum
Step #1 - "make-tests": 55b755dce003: Download complete
Step #1 - "make-tests": 4f4fb700ef54: Verifying Checksum
Step #1 - "make-tests": 4f4fb700ef54: Download complete
Step #1 - "make-tests": 34766222467c: Verifying Checksum
Step #1 - "make-tests": 34766222467c: Download complete
Step #1 - "make-tests": 3b7e397d0b33: Verifying Checksum
Step #1 - "make-tests": 3b7e397d0b33: Download complete
Step #1 - "make-tests": c79bddf330f7: Verifying Checksum
Step #1 - "make-tests": c79bddf330f7: Download complete
Step #1 - "make-tests": c2056d933cd6: Pull complete
Step #1 - "make-tests": d3f895247ac5: Pull complete
Step #1 - "make-tests": 05d199724b11: Pull complete
Step #1 - "make-tests": 34766222467c: Pull complete
Step #1 - "make-tests": 7e08c6ffd97f: Verifying Checksum
Step #1 - "make-tests": 7e08c6ffd97f: Download complete
Step #1 - "make-tests": c79bddf330f7: Pull complete
Step #1 - "make-tests": 55b755dce003: Pull complete
Step #1 - "make-tests": 4f4fb700ef54: Pull complete
Step #1 - "make-tests": 3b7e397d0b33: Pull complete
Step #1 - "make-tests": 7e08c6ffd97f: Pull complete
Step #1 - "make-tests": Digest: sha256:be8f68b0966c5c97f08ffa0ea5b4ce155995d0878689f9f7d8df550e8464d79c
Step #1 - "make-tests": Status: Downloaded newer image for us-central1-docker.pkg.dev/hpc-toolkit-dev/hpc-toolkit-repo/test-runner:latest
Step #1 - "make-tests": us-central1-docker.pkg.dev/hpc-toolkit-dev/hpc-toolkit-repo/test-runner:latest
Step #1 - "make-tests": **************** vetting go code **********************
Step #1 - "make-tests": **************** running gcluster unit tests **************
Step #1 - "make-tests": go vet ./cmd/... ./pkg/...
Step #1 - "make-tests": go: downloading gopkg.in/check.v1 v1.0.0-20201130134442-10cb98267c6c
Step #1 - "make-tests": go: downloading github.com/spf13/afero v1.11.0
Step #1 - "make-tests": go: downloading github.com/zclconf/go-cty-debug v0.0.0-20240509010212-0d6042c53940
Step #1 - "make-tests": go: downloading github.com/kr/pretty v0.3.1
Step #1 - "make-tests": go: downloading github.com/rogpeppe/go-internal v1.11.0
Step #1 - "make-tests": go: downloading github.com/kr/text v0.2.0
Step #1 - "make-tests": go test -cover ./cmd/... ./pkg/... 2>&1 |  perl tools/enforce_coverage.pl
Step #1 - "make-tests": ok  	hpc-toolkit/cmd	0.124s	coverage: 41.5% of statements
Step #1 - "make-tests": 	hpc-toolkit/pkg/logging		coverage: 0.0% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/config	0.117s	coverage: 86.9% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/deploymentio	0.011s	coverage: 88.2% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/inspect	0.418s	coverage: 86.0% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/modulereader	0.196s	coverage: 86.3% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/modulewriter	0.072s	coverage: 80.6% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/shell	0.552s	coverage: 25.3% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/sourcereader	0.988s	coverage: 88.8% of statements
Step #1 - "make-tests": ok  	hpc-toolkit/pkg/validators	0.028s	coverage: 13.7% of statements
Step #1 - "make-tests": **************** building gcluster ************************
Step #1 - "make-tests": *********** running "Golden copy" tests ***********
Step #1 - "make-tests": tools/validate_configs/golden_copies/validate.sh
Step #1 - "make-tests": Testing igc_pkr
Step #1 - "make-tests": Testing igc_tf
Step #1 - "make-tests": Testing merge_flatten
Step #1 - "make-tests": Testing text_escape
Step #1 - "make-tests": Testing versioned_blueprint
Step #1 - "make-tests": *********** running basic integration tests ***********
Step #1 - "make-tests": tools/validate_configs/validate_configs.sh
Step #1 - "make-tests": Running tests in 8 processes
Step #1 - "make-tests": testing examples/gke-a3-megagpu.yaml in /tmp/tmp.79iy0k9ztY
Step #1 - "make-tests": testing examples/ml-slurm-v5-legacy.yaml in /tmp/tmp.bM9D7riwhJ
Step #1 - "make-tests": testing examples/gke-storage-parallelstore.yaml in /tmp/tmp.pKG1BGV2k3
Step #1 - "make-tests": testing examples/image-builder.yaml in /tmp/tmp.Ff1x1KEQ30
Step #1 - "make-tests": testing examples/hpc-slurm-v5-legacy.yaml in /tmp/tmp.2NQOW2PyNR
Step #1 - "make-tests": testing examples/ml-gke.yaml in /tmp/tmp.Ta9R7zxD2I
Step #1 - "make-tests": testing examples/ml-slurm.yaml in /tmp/tmp.oGz5WnWXkY
Step #1 - "make-tests": testing examples/pfs-parallelstore.yaml in /tmp/tmp.2CrSu6uiNd
Step #1 - "make-tests": 
Step #1 - "make-tests": Error: Failed to query available provider packages
Step #1 - "make-tests": 
Step #1 - "make-tests": Could not retrieve the list of available versions for provider
Step #1 - "make-tests": hashicorp/google-private: provider registry registry.terraform.io does not
Step #1 - "make-tests": have a provider named registry.terraform.io/hashicorp/google-private
Step #1 - "make-tests": 
Step #1 - "make-tests": All modules should specify their required_providers so that external
Step #1 - "make-tests": consumers will get the correct providers when using a module. To see which
Step #1 - "make-tests": modules are currently depending on hashicorp/google-private, run the
Step #1 - "make-tests": following command:
Step #1 - "make-tests":     terraform providers
Step #1 - "make-tests": *** ERROR: terraform init failed for examples/ml-slurm.yaml, logs in /tmp/tmp.oGz5WnWXkY/ml-slurm-ogz5wnwxky/cluster
Step #1 - "make-tests": 
Step #1 - "make-tests": Error: Failed to query available provider packages
Step #1 - "make-tests": 
Step #1 - "make-tests": Could not retrieve the list of available versions for provider
Step #1 - "make-tests": hashicorp/google-private: provider registry registry.terraform.io does not
Step #1 - "make-tests": have a provider named registry.terraform.io/hashicorp/google-private
Step #1 - "make-tests": 
Step #1 - "make-tests": All modules should specify their required_providers so that external
Step #1 - "make-tests": consumers will get the correct providers when using a module. To see which
Step #1 - "make-tests": modules are currently depending on hashicorp/google-private, run the
Step #1 - "make-tests": following command:
Step #1 - "make-tests":     terraform providers
Step #1 - "make-tests": *** ERROR: terraform init failed for examples/image-builder.yaml, logs in /tmp/tmp.Ff1x1KEQ30/image-builder-ff1x1keq30/cluster
Step #1 - "make-tests": 
Step #1 - "make-tests": Error: Failed to query available provider packages
Step #1 - "make-tests": 
Step #1 - "make-tests": Could not retrieve the list of available versions for provider
Step #1 - "make-tests": hashicorp/google-private: provider registry registry.terraform.io does not
Step #1 - "make-tests": have a provider named registry.terraform.io/hashicorp/google-private
Step #1 - "make-tests": 
Step #1 - "make-tests": All modules should specify their required_providers so that external
Step #1 - "make-tests": consumers will get the correct providers when using a module. To see which
Step #1 - "make-tests": modules are currently depending on hashicorp/google-private, run the
Step #1 - "make-tests": following command:
Step #1 - "make-tests":     terraform providers
Step #1 - "make-tests": *** ERROR: terraform init failed for examples/pfs-parallelstore.yaml, logs in /tmp/tmp.2CrSu6uiNd/pfs-parallelstore-2crsu6uind/primary
Step #1 - "make-tests": *** ERROR: a test failed. Exiting with status 1.
Step #1 - "make-tests": make: *** [Makefile:160: validate_configs] Error 1
Finished Step #1 - "make-tests"
ERROR
ERROR: build step 1 "us-central1-docker.pkg.dev/hpc-toolkit-dev/hpc-toolkit-repo/test-runner" failed: step exited with non-zero status: 2

Build Log: https://console.cloud.google.com/cloud-build/builds/ce6b50d9-20a2-4fdc-8bee-78fa62da5dcd?project=508417052821