I don’t think the pull request that added the feature included a setting to turn it off.
https://github.com/discourse/discourse/pull/31947
I currently delete the user from their admin profile page instead of from the review queue. That seems to prevent the email.