Exit with a non-zero exit code if we have unrecoverable errors

Exit with a non-zero exit code if we have unrecoverable errors #11439