Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bench old commits #482

Closed
wants to merge 6 commits into from
Closed

Bench old commits #482

wants to merge 6 commits into from

Conversation

ElectreAAS
Copy link
Contributor

@ElectreAAS ElectreAAS commented Nov 13, 2023

Fixes #379.

  • pipeline/lib/commits.ml contains the important part: the actual git command to run to traverse the commit history.
  • pipeline/libs/models.ml[i] contains the necessary two new functions that query the database, to make sure we don't benchmark twice the same commit.

Note: This PR requires some changes to the API of ocurrent (namely this PR: ocurrent/ocurrent#442), and hence is in draft mode to make sure it doesn't get merged before the PR on ocurrent is properly reviewed.
It is, however, ready to be reviewed in the current-bench context. The API changes in ocurrent are trivials from our point of view.

Edit: ocurrent/ocurrent#442 has been merged, this is ready for review

current-bench.opam Outdated Show resolved Hide resolved
@art-w
Copy link
Contributor

art-w commented Nov 29, 2023

Thanks! This was a much awaited feature!

A couple of thoughts which prevents this from going live:

  • Can we disable it for repos that use a cron schedule? (ocaml/ocaml runs its benchmarks every week, precisely to avoid benchmarking too many commits)
  • Is the commit order preserved when plotted on a graph?
  • How do we get rid of old commits that were removed? (e.g. following a PR rebase)

@ElectreAAS
Copy link
Contributor Author

  • Can we disable it for repos that use a cron schedule? (ocaml/ocaml runs its benchmarks every week, precisely to avoid benchmarking too many commits)

I have no idea

  • Is the commit order preserved when plotted on a graph?

I also have no idea, but it seems testable. I don't have time to allocate to this nowadays, but someone else could.

  • How do we get rid of old commits that were removed? (e.g. following a PR rebase)

This PR does not take that scenario into account.

@ElectreAAS ElectreAAS closed this Oct 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Missing benchmarks when pushing multiple commits at once
2 participants