Dubug pickle error

[manuelgloeckler]

No description provided.

[codecov]

Codecov Report

Attention: Patch coverage is 92.85714% with 1 line in your changes missing coverage. Please review.

Project coverage is 26.38%. Comparing base (d3f22b5) to head (27cb6ab).
Report is 14 commits behind head on main.

Files with missing lines	Patch %	Lines
sbi/utils/restriction_estimator.py	50.00%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##             main    #1377       +/-   ##
===========================================
- Coverage   89.40%   26.38%   -63.03%     
===========================================
  Files         118      119        +1     
  Lines        8715     8786       +71     
===========================================
- Hits         7792     2318     -5474     
- Misses        923     6468     +5545     

Flag	Coverage Δ
unittests	26.38% <92.85%> (-63.03%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
sbi/inference/posteriors/score_posterior.py	32.83% <100.00%> (-64.09%)	⬇️
sbi/inference/posteriors/vi_posterior.py	23.03% <100.00%> (-68.95%)	⬇️
sbi/inference/potentials/score_based_potential.py	28.78% <100.00%> (-68.23%)	⬇️
sbi/samplers/rejection/__init__.py	100.00% <100.00%> (ø)
sbi/samplers/score/__init__.py	100.00% <100.00%> (ø)
sbi/samplers/score/diffuser.py	28.30% <100.00%> (ø)
sbi/samplers/score/predictors.py	53.84% <ø> (-43.66%)	⬇️
sbi/samplers/vi/__init__.py	100.00% <ø> (ø)
sbi/samplers/vi/vi_divergence_optimizers.py	22.77% <ø> (-64.40%)	⬇️
sbi/utils/restriction_estimator.py	16.91% <50.00%> (-67.99%)	⬇️

... and 87 files with indirect coverage changes

[manuelgloeckler]

Can locally reproduce it using:

pytest -v -x -n auto -m "not slow and not gpu" --cov=sbi --cov-report=xml  tests/circular_import_test.py tests/mcmc_test.py::test_c2st_slice_np_vectorized_parallelized_on_Gaussian

Weirdly enough, the order matters i.e. first executing the mcmc test and then the circular import test will just work fine...

[manuelgloeckler]

Error source indeed is the reset environment for some reason

[manuelgloeckler]

Okey lesson learned is to not mess with sys.modules as pickle use it and can be sensitive to any change (even if it is just removing an readding things)