How to prevent user count error

[zebamba]

How to prevent the error when a role or permission does not have any user?

I am listing all roles and all permissions, for the requirements I can't left anyone out, but when I try

->withCount(['roles', 'users'])

If a role or permission does not have any user relationship throws an error

Error: Class name must be a valid object or a string in file /vagrant/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Concerns/HasRelationships.php on line 745

Any thoughts?