I don’t think the pull request that added the feature included a setting to turn it off.
I currently delete the user from their admin profile page instead of from the review queue. That seems to prevent the email.
1 me gusta