Reply key / email address check not working? (replies by email)

Make sure the enable_staged_users site setting is enabled.

For categories, enabling “Accept emails from anonymous users with no accounts” in the category’s settings should work.