Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle flaky unit tests #18

Open
gferragu opened this issue Apr 27, 2023 · 0 comments
Open

Handle flaky unit tests #18

gferragu opened this issue Apr 27, 2023 · 0 comments
Assignees
Labels

Comments

@gferragu
Copy link
Owner

We know that gmprocess has a couple of flaky unit tests that can fail in CI runners on both Gitlab and Azure due to dependence on runner state and/or tests running in parallel.

We should not indicate total failure for this case. For now, this flexibility can be added with the --maxfail=N argument via pytest

A better solution is to use a fixture to mark specific tests as flaky and use this, or the Azure project settings, to re-run some tests and check if the continually fail

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant