Benchmark CI failures due to too many requests

[christiangnrd]

Example

Seems like buildkite rate limits are org-wide. Is there anything we can do in this repo to minimize the chances of running into this limit?

I tried debugging until I realized benchmark picks up the main branch workflow, but EnricoMI/download-buildkite-action has hardcoded timings for retry attempts so I don't know if we could do much.

[maleadt]

I tried debugging until I realized benchmark picks up the main branch workflow

That's because of the workflow triggering on the pull request target:

Metal.jl/.github/workflows/Benchmark.yml

Lines 9 to 11 in 6ac7f3c

	pull_request_target:
	branches:
	- main

EnricoMI/download-buildkite-action has hardcoded timings for retry attempts so I don't know if we could do much.

Should be easy enough to make that configurable, either in a fork of the plugin or by creating a PR?

[christiangnrd]

EnricoMi/download-buildkite-artifact-action#28