You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It is sometimes useful to run benchmarks on every commit to the default branch (posting comments on commits) in addition to on pull requests. The results may differ from those posted to the pull requests if the pull request head is out of date.
The text was updated successfully, but these errors were encountered:
One tricky part about this is that the variability in performance across runners tends to be larger than variability over a single action. The action runner is some small virtual machine and while even a single action is pretty noisy, multiple actions will be noisier since it might be a completely different machine. But worth thinking about, and maybe it's not as big a deal as I think.
It is sometimes useful to run benchmarks on every commit to the default branch (posting comments on commits) in addition to on pull requests. The results may differ from those posted to the pull requests if the pull request head is out of date.
The text was updated successfully, but these errors were encountered: