Is torch.compile called under the head somewhere?

[RuABraun]

I would guess not, but noticed massive speed improvements from using pytorch 2.x and pytorch-lightning 2.x and am wondering if that may be the reason.