Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: cluster_creation failed #125986

Closed
cockroach-teamcity opened this issue Jun 21, 2024 · 2 comments
Closed

roachtest: cluster_creation failed #125986

cockroach-teamcity opened this issue Jun 21, 2024 · 2 comments
Labels
branch-release-23.1.23-rc O-roachtest O-robot Originated from a bot. T-testeng TestEng Team X-infra-flake the automatically generated issue was closed due to an infrastructure problem not a product issue
Milestone
23.1

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Jun 21, 2024 •
edited by cockroach-jira-scripts
Loading

roachtest.cluster_creation failed with artifacts on release-23.1.23-rc @ 8705c1e39813e08ab5d582b19f401e1ad5dab4c5:

test copyfrom/crdb-atomic/sf=1/nodes=1 failed: (test_runner.go:747).func4: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2204-jammy-v20230727 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account [email protected] --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n2-standard-4 --min-cpu-platform Intel Ice Lake --labels usage=roachtest,created=2024-06-21t07_29_26z,roachprod=true,cluster=teamcity-15757245-1718948440-34-n1cpu4,lifetime=12h0m0s,arch=amd64 --metadata-from-file startup-script=/tmp/gce-startup-script755284183 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-c teamcity-15757245-1718948440-34-n1cpu4-0001]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
---
code: ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS
errorDetails:
- help:
    links:
    - description: Troubleshooting documentation
      url: https://cloud.google.com/compute/docs/resource-error
- localizedMessage:
    locale: en-US
    message: A n2-standard-4 VM instance with 1 local SSD(s) is currently unavailable
      in the us-east1-c zone. Try requesting the VM in another zone. For more information,
      view the troubleshooting documentation.
- errorInfo:
    domain: compute.googleapis.com
    metadatas:
      attachment: local-ssd:1
      vmType: n2-standard-4
      zone: us-east1-c
      zonesAvailable: ''
    reason: stockout
message: The zone 'projects/cockroach-ephemeral/zones/us-east1-c' does not have enough
  resources available to fulfill the request.  '(resource type:compute)'.: exit status 1 [owner=test-eng]

Parameters:

  • ROACHTEST_cloud=gce
  • ROACHTEST_cpu=4
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-39700

Jira issue: CRDB-39700
@cockroach-teamcity cockroach-teamcity added branch-release-23.1.23-rc O-roachtest O-robot Originated from a bot. X-infra-flake the automatically generated issue was closed due to an infrastructure problem not a product issue labels Jun 21, 2024
@cockroach-teamcity cockroach-teamcity added this to the 23.1 milestone Jun 21, 2024
@blathers-crl blathers-crl bot added the T-testeng TestEng Team label Jun 21, 2024
This was referenced Jun 21, 2024
Open
Closed
Open
@cockroach-teamcity
Copy link
Member Author

roachtest.cluster_creation failed with artifacts on release-23.1.23-rc @ 8705c1e39813e08ab5d582b19f401e1ad5dab4c5:

test unoptimized-query-oracle/disable-rules=half/seed-multi-region failed: (test_runner.go:747).func4: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2204-jammy-v20230727 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account [email protected] --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n2-standard-4 --min-cpu-platform Intel Ice Lake --labels usage=roachtest,roachprod=true,cluster=teamcity-15757245-1718948440-109-n9cpu4-geo,lifetime=12h0m0s,arch=amd64,created=2024-06-21t11_17_33z --metadata-from-file startup-script=/tmp/gce-startup-script4184332939 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-c teamcity-15757245-1718948440-109-n9cpu4-geo-0001]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
---
code: ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS
errorDetails:
- help:
    links:
    - description: Troubleshooting documentation
      url: https://cloud.google.com/compute/docs/resource-error
- localizedMessage:
    locale: en-US
    message: A n2-standard-4 VM instance with 1 local SSD(s) is currently unavailable
      in the us-east1-c zone. Try requesting the VM in another zone. For more information,
      view the troubleshooting documentation.
- errorInfo:
    domain: compute.googleapis.com
    metadatas:
      attachment: local-ssd:1
      vmType: n2-standard-4
      zone: us-east1-c
      zonesAvailable: ''
    reason: stockout
message: The zone 'projects/cockroach-ephemeral/zones/us-east1-c' does not have enough
  resources available to fulfill the request.  '(resource type:compute)'.: exit status 1 [owner=test-eng]

Parameters:

  • ROACHTEST_cloud=gce
  • ROACHTEST_cpu=4
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

This was referenced Jun 24, 2024
Closed
Closed
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Jul 3, 2024
Closed
This was referenced Jul 11, 2024
Open
Closed
Closed
This was referenced Aug 2, 2024
Closed
Closed
This was referenced Aug 14, 2024
Closed
Closed
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Aug 27, 2024
Closed
@renatolabs
Copy link
Contributor

Branch deleted.

@github-project-automation github-project-automation bot moved this from Triage to Done in Test Engineering Sep 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
branch-release-23.1.23-rc O-roachtest O-robot Originated from a bot. T-testeng TestEng Team X-infra-flake the automatically generated issue was closed due to an infrastructure problem not a product issue
Projects
No open projects
Test Engineering
Status: Done
Milestone
23.1
Development

No branches or pull requests
2 participants
@cockroach-teamcity @renatolabs