Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[9.18] chg: ci: Set stricter limits for respdiff testing
Adjust the limit of maximum disagreements in respdiff results based on recent pipeline results. The respdiff and respdiff:asan seem to have almost identical results, typically around 0.07 % of differences with ocassional spikes up to around 0.11 %. Similar results are for respdiff:tsan, perhaps with more common spikes with values up to around 0.12 %. Set the limit to 0.15 % to allow for some tolerance due to network conditions, time of day etc. The respdiff:third-party has a slightly higher disagreements average, with typical values being around 0.12 %. Set the limit to 0.2 %. Exceeding either of those values should be quite clear indication that some resolution behaviour has changed, since the values appear to be very stable within the newly configured limits. Backport of MR !9950 Merge branch 'backport-nicki/ci-respdiff-limits-9.18' into 'bind-9.18' See merge request isc-projects/bind9!9990
- Loading branch information