Skip to content

Add image comparison tests using pytest-mpl #376

Add image comparison tests using pytest-mpl

Add image comparison tests using pytest-mpl #376

Triggered via pull request January 16, 2024 02:04
@mx-mothmx-moth
synchronize #128
pytest-mpl
Status Failure
Total duration 3m 40s
Artifacts 6
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

ci.yaml

on: pull_request
Matrix: test
Fit to window
Zoom out
Zoom in

Annotations

12 errors and 50 warnings
test_transect.test_plot: tests/test_transect.py#L1
Failed: Error: Image files did not match. RMS Value: 62.96593573483176 Expected: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/baseline.png Actual: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/result.png Difference: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/result-failed-diff.png Tolerance: 2
test_transect.test_plot_no_intersection: tests/test_transect.py#L1
Failed: Error: Image files did not match. RMS Value: 6.923595859784829 Expected: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/baseline.png Actual: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/result.png Difference: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/result-failed-diff.png Tolerance: 2
test_transect.test_plot: tests/test_transect.py#L1
Failed: Error: Image files did not match. RMS Value: 62.96593573483176 Expected: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/baseline.png Actual: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/result.png Difference: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/result-failed-diff.png Tolerance: 2
test_transect.test_plot_no_intersection: tests/test_transect.py#L1
Failed: Error: Image files did not match. RMS Value: 6.923595859784829 Expected: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/baseline.png Actual: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/result.png Difference: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/result-failed-diff.png Tolerance: 2
python 3.9, pinned dependencies
Process completed with exit code 1.
test_transect.test_plot: tests/test_transect.py#L1
Failed: Error: Image files did not match. RMS Value: 62.96593573483176 Expected: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/baseline.png Actual: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/result.png Difference: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/result-failed-diff.png Tolerance: 2
test_transect.test_plot_no_intersection: tests/test_transect.py#L1
Failed: Error: Image files did not match. RMS Value: 6.923595859784829 Expected: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/baseline.png Actual: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/result.png Difference: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/result-failed-diff.png Tolerance: 2
python 3.10, pinned dependencies
Process completed with exit code 1.
python 3.11, latest dependencies
Process completed with exit code 1.
test_transect.test_plot: tests/test_transect.py#L1
Failed: Error: Image files did not match. RMS Value: 62.96593573483176 Expected: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/baseline.png Actual: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/result.png Difference: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot/result-failed-diff.png Tolerance: 2
test_transect.test_plot_no_intersection: tests/test_transect.py#L1
Failed: Error: Image files did not match. RMS Value: 6.923595859784829 Expected: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/baseline.png Actual: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/result.png Difference: /home/runner/work/emsarray/emsarray/mpl-results/tests.test_transect.test_plot_no_intersection/result-failed-diff.png Tolerance: 2
python 3.11, pinned dependencies
Process completed with exit code 1.
python 3.9, pinned dependencies
The `python-version` input is not set. The version of Python currently in `PATH` will be used.
python 3.9, pinned dependencies
Mamba support is still experimental and can result in differently solved environments!
python 3.9, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/497deca9.json" was modified by another program
python 3.9, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/09cdf8bf.json" was modified by another program
python 3.9, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/47929eba.json" was modified by another program
python 3.9, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/3e39a7aa.json" was modified by another program
python 3.9, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/2ce54b42.json" was modified by another program
python 3.9, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/4ea078d6.json" was modified by another program
python 3.10, pinned dependencies
The `python-version` input is not set. The version of Python currently in `PATH` will be used.
python 3.10, pinned dependencies
Mamba support is still experimental and can result in differently solved environments!
python 3.10, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/497deca9.json" was modified by another program
python 3.10, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/09cdf8bf.json" was modified by another program
python 3.10, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/47929eba.json" was modified by another program
python 3.10, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/3e39a7aa.json" was modified by another program
python 3.10, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/2ce54b42.json" was modified by another program
python 3.10, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/4ea078d6.json" was modified by another program
python 3.11, latest dependencies
The `python-version` input is not set. The version of Python currently in `PATH` will be used.
python 3.11, latest dependencies
Mamba support is still experimental and can result in differently solved environments!
python 3.11, latest dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/497deca9.json" was modified by another program
python 3.11, latest dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/09cdf8bf.json" was modified by another program
python 3.11, latest dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/47929eba.json" was modified by another program
python 3.11, latest dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/3e39a7aa.json" was modified by another program
python 3.11, latest dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/2ce54b42.json" was modified by another program
python 3.11, latest dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/4ea078d6.json" was modified by another program
lint
The `python-version` input is not set. The version of Python currently in `PATH` will be used.
lint
Mamba support is still experimental and can result in differently solved environments!
lint
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/497deca9.json" was modified by another program
lint
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/09cdf8bf.json" was modified by another program
lint
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/47929eba.json" was modified by another program
lint
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/3e39a7aa.json" was modified by another program
lint
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/2ce54b42.json" was modified by another program
lint
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/4ea078d6.json" was modified by another program
lint
Cache paths are empty. Please check the previous logs and make sure that the python version is specified
python 3.11, pinned dependencies
The `python-version` input is not set. The version of Python currently in `PATH` will be used.
python 3.11, pinned dependencies
Mamba support is still experimental and can result in differently solved environments!
python 3.11, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/497deca9.json" was modified by another program
python 3.11, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/09cdf8bf.json" was modified by another program
python 3.11, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/47929eba.json" was modified by another program
python 3.11, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/3e39a7aa.json" was modified by another program
python 3.11, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/2ce54b42.json" was modified by another program
python 3.11, pinned dependencies
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/4ea078d6.json" was modified by another program
docs
The `python-version` input is not set. The version of Python currently in `PATH` will be used.
docs
Mamba support is still experimental and can result in differently solved environments!
docs
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/497deca9.json" was modified by another program
docs
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/09cdf8bf.json" was modified by another program
docs
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/47929eba.json" was modified by another program
docs
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/3e39a7aa.json" was modified by another program
docs
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/2ce54b42.json" was modified by another program
docs
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/4ea078d6.json" was modified by another program
docs
Cache paths are empty. Please check the previous logs and make sure that the python version is specified

Artifacts

Produced during runtime
Name Size
Docs Expired
17.2 MB
MPL image comparison report - python 3.10, pinned dependencies Expired
420 KB
MPL image comparison report - python 3.11, latest dependencies Expired
420 KB
MPL image comparison report - python 3.11, pinned dependencies Expired
420 KB
MPL image comparison report - python 3.9, pinned dependencies Expired
420 KB
Python package Expired
190 KB