Are those users who never activated their accounts?
There is a setting for them: purge unactivated users grace period days
“Grace period (in days) before a user who has not activated their account is deleted. Set to 0 to never purge unactivated users.”