I have discourse set up with SendGrid, and most users are experiencing issues with notifications from the forum going into spam/junk folders. I have SPF, DKIM and DMARC records set up on my server.
I think the issue is related to SendGrid, but I’m not sure. I am wondering if there is a way of manually sending emails from discourse to junk/spam checking services such as Is Not Spam, SpamScoreChecker, etc. I suppose I could add new users using the email addresses linked to these services, create a group for these users, and then post content in this group, but I am wondering if there is a simpler way?
I am also wondering about people’s experience of SendGrid and whether I need to be looking to another service?
One thing I found is that sometimes you have to pay for a dedicated IP: if you happen to be sharing that IP with someone who is sending real spam, you are totally screwed.
I have a dedicated IP, with the correct mail settings, which is what leads me to wonder if the issue is related to SendGrid.
I am wondering whether there is a facility within discourse where I can send a test email to Mail Tester, or whether I have to create a user account with the temporary Mail Tester email address?
Thanks - that works well. I got an 8/10 score on Mail Tester.
The two issues are as follows:
-1.084 URIBL_GREY Contains an URL listed in the URIBL greylist
URIs: sendgrid.net
You can request to be removed from the URIBL greyest
Which would seem to suggest that sendgrid doesn’t have a great reputation.
and…
[Sender ID] forum.open-dialogue.net does not allow your server 167.89.55.59 to use noreply@forum.open-dialogue.net
Sender ID is like SPF, but it checks the FROM address, not the bounce address.
You do not have a SPF record, please add the following one to your domain forum.open-dialogue.net:
v=spf1 a mx include:sendgrid.net ~all
SPF records work exactly the same no matter where in the hierarchy they live. Put an SPF or appropriately-formatted TXT record on forum.open-dialogue.net.
Thanks Matt. I have tried to do this in the settings for my domain on Digital Ocean. I have entered the following TXT record under the domain open-dialogue.net:
Similarly, a cache-skipping +trace run doesn’t show it, so time to go back and double-check that record, and perhaps get in DO’s ear if you can’t see what’s wrong.
I have sorted the issue with the SPF record - I simply had to use ‘forum’ as the name of the TXT record. I am currently getting a score of 8.9/10, with the primary issue being URIBL greylist as mentioned above, which seemingly I can’t do anything about.
There are a couple of other minor issues which don’t seem to affect the score but which have been flagged by Mail Tester, and I’m wondering if I can do anything about these?
Firstly:
Your domains are not aligned. We can't check DMARC.
A DMARC policy allows a sender to indicate that their emails are protected by SPF and/or DKIM, and give instruction if neither of those authentication methods passes. Please be sure you have a DKIM and SPF set before using DMARC.
Before using DMARC, you should make sure the domains used in the Envelope From (e.g., Return-Path or Mail-From), the "Friendly" From (i.e., "Header" From) and the d=domain in the DKIM-Signature are the same
DMARC DNS entry found for the domain _dmarc.forum.open-dialogue.net:
"v=DMARC1; p=none"
Verification details:
mail-tester.com; dmarc=none header.from=forum.open-dialogue.net
mail-tester.com; dkim=pass (1024-bit key; unprotected) header.d=sendgrid.net header.i=@sendgrid.net header.b=BdpIOUIj; dkim-atps=neutral
From Domain: forum.open-dialogue.net
DKIM Domain: sendgrid.net
Then:
Weight of the HTML version of your message: 8KB.
Your message contains 22% of text.
Also, a fairly simple question - should asking users to add noreply@forum.open-dialogue.net to their safe senders list (and/or marking emails from this address as not junk/spam) be enough to ensure that all emails lands in inboxes?
The only guarantee when it comes to mail delivery is that there are no guarantees. Asking people to whitelist your sending address or doing anything else in their mail client might help, but every mail recipient service treats those signals differently.
Actually, there always is a Sendgrid link in the test email – so please do check that you disabled click tracking, but doing so will not eliminate the warning in mail-tester.com.
I think that was enabled by default. Now that I have disabled it, it does appear to have removed the URIBL_GREY score. However there are now other issues being reported. The main one affecting the score is this:
-1.729 RAZOR2_CHECK Listed in Razor2 (http://razor.sf.net/)
It seems like RAZOR2_CHECK scores are based on an analysis of the content of the email, rather than having anything to do with the sender - is there any way of addressing this?
There are also a couple of other more minor issues:
-0.276 URIBL_RHS_DOB Contains an URI of a new domain (Day Old Bread)
URIs: open-dialogue.net
and
Weight of the HTML version of your message: 3KB. Your message contains 63% of text.
and finally
Your message does not contain a List-Unsubscribe header
Is there anything that can be done about any of these issues?
Is that error specifically referring to the test e-mail? If so, that’s fine – we just did a round of “add List-Unsub to everywhere” changes, so as long as you’re running up-to-date code, every real e-mail should have the header set appropriately.
I even thought of that possibility before posting, and decided not to check
As a believer of Murphy’s Law, now I’m sure that you hadn’t done that change before I posted, but my posting created a ripple in space-time that allowed you to travel back in time and correct this one month ago