Does AI triage automation scan DMs between regular users?

Hi,

I have configured the “Triage posts using AI” automation for content moderation on my platform (madeira.community — a multilingual business directory for Madeira island).

The automation works perfectly for public posts. However, I enabled “Include personal messages” option and found that DMs between regular users are not being scanned at all.

My concern is real: bad actors can use private messages to conduct illegal activities — drug dealing, sharing stolen financial data, grooming — while completely bypassing AI moderation that works fine on public content.

My questions:

  1. Does “Include personal messages” actually support scanning DMs between two regular users (non-staff)?

  2. If not — is this by design or a known limitation?

  3. Is there any supported way to apply AI triage to private messages between regular users?

I found a reference to a commit “Skip PM scanning in LLM triage by default” which suggests this may be intentional. But the UI option exists — so I am confused about what it actually does.

Thank you

1 Like

Yes it does, if you enable that option it should be scanning PM’s.

How did you determine this?

3 Likes

“I tested it by sending a private message between two regular users (testUser to darinauser, both non-staff) with clearly illegal content: ‘кокаин. оружие. гранаты’ and ‘порно. грязь. разврат. насилие’. The messages were delivered and not flagged. The Review Queue remained empty. The same content in public posts was flagged immediately.”

I can confirm that they were not processed, the topic ID’s of those PM’s (210, 211, 212 and 214) and post id’s are not in the ai_api_audit_logs table.

I think “Topic Type” “All topics” means all topics that are not private messages.
Could you try to leave that one empty?

3 Likes

"That worked! Thank you Richard. Leaving the Topic Type empty fixed it — DMs between regular users are now being scanned.
I’m now planning to set up two separate automations:

One for public posts with a strict moderation prompt
One for private messages with a lighter prompt — flagging only the most serious violations (CSAM, drug dealing, weapons)

This way public content gets full moderation while private conversations have more appropriate boundaries."

the topic can be closed. THX!

2 Likes

Hmm “all topics” does seem a little unclear in this context… maybe we should update to clarify

  • all topics topics (all categories)
  • Public Topics (exclude all secure categories) topics (public categories only)
  • personal messages only
4 Likes

The “All Topics” part made me think all content would be reviewed.
I didn’t even consider that leaving the field blank would result in all content being reviewed.

1 Like

I think having a single dropdown is pretty limited and three separate options would be better and definitely more clear to a user.

  • public topics yes/no
  • non-public topics yes/no
  • private messages yes/no

There are 8 possible situations and the drop down only covers four of them.

1 Like

maybe so ?

  • All ( topics + pm )

  • public topics only

  • non-public topics only

  • non-public + pm

  • private messages only

That does not cover “regular topics ( both public and non-public), but no PM’s” which would be a pretty logical choice.

And, albeit a less likely choice, “public topics, and PM’s”

1 Like