ci: set PT & HF chase OS dependent

[Borda]

What does this PR do?

There seems to be some problem on Windows with Unix models?

Before submitting

• Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure to update the docs?
• Did you write any new necessary tests?

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

---

📚 Documentation preview 📚: https://torchmetrics--2357.org.readthedocs.build/en/2357/

[codecov]

Codecov Report

Merging #2357 (f37cc8d) into master (35bdeb6) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files

@@          Coverage Diff           @@
##           master   #2357   +/-   ##
======================================
  Coverage      69%     69%           
======================================
  Files         305     305           
  Lines       17149   17149           
======================================
  Hits        11832   11832           
  Misses       5317    5317