Add some automated tests

[Sytten]

Hi all!
The current main branch is broken for a lot of folks. I don't want to put blame on anyone but its not great.
I will push a fix to restore it to a good state but ideally we would need automated testing on windows/mac/linux with async-std/tokio variants.
That would ensure we dont merge broken code.