Reply by Email not working

I am having issues with Reply by Email. A user receives an email when tagged in a Topic, however the “Reply” address is noreply@forum.site.com

This is the same email address I have set in “notification email”

There is no ‘reply key’ defined in the email a user receives.

Here are my other settings:

Any ideas what I’m missing?