AI spam bot says it is not spam but scan log says it is spam

Support
1

I’ve enabled the Discourse AI spam handling on our forum. I’ve set up Claude Sonnet 4 with an API key and selected the Spam detector persona.

I did a test post that is clearly spam. Nothing subtle about it.

It was not blocked and was posted immediately.

When I gave the post URL to the spam bot using the test feature, the result says Not spam, but in the Scan log it says: SPAM - This is a clear promotional advertisement…

CleanShot 2025-08-19 at 17.05.24@2x
CleanShot 2025-08-19 at 17.05.24@2x1298×1566 223 KB

My expectation would be that the result would be SPAM, matching the Scan log declaration of SPAM. And that this would then queue up the post for review by admins and moderators, for example.

Might anyone be able to share what I’m missing? I’m no expert – so am open to any guidance!

Thank you!

2

What is the trust level of the user who posted? AI Spam will skip posts from TL2+ users.

Regarding the test, there’s a bug in the test code and it should say “spam.” I’ll work on a fix.

3 Likes
4

Thank you for your reply!

The user I used to post is Trust Level new user

Any thoughts on why the post made it through?

I appreciate your help!