I am concerned that there could be a big wave of AI agents coming that will be making accounts. We just got one today from ilands.app which is some kind of LLM agent. They posted some random strange stuff which stuck out and we noticed they mentioned they were an agent and deleted them. Is anyone else seeing this and any plans to deal with it?
AI-generated summary
scottfsmith raises concerns about a potential surge of AI agents creating accounts, citing a recent instance from ilands.app where an agent posted strange content before deleting it. While NateDhaliwal suggests using Discourse AI’s spam detection to identify AI-generated content, scottfsmith clarifies that the issue specifically involves fully autonomous AI accounts rather than humans pasting AI responses.
Several solutions are proposed to mitigate this threat. Lilly recommends implementing discourse captcha. nickdb offers a more comprehensive strategy: identifying user-agents, utilizing crawler block lists and IP blocking, and increasing entry difficulty through layered checks for new users without excessively annoying legitimate members. They also suggest building a curated list of example posts to help classify potential AI bots. The discussion concludes with merefield noting that this phenomenon is already occurring.
2 Likes
Take a look at:
I wonder if you could use the AI plugin’s Spam detection to recognise AI-generated content. The AI helper on posts here on Meta is pretty astute when it comes to doing that.
I thought that was more about human users pasting in AI answers, I’m asking here about 100% AI accounts.
It would be easier to recognize them compared to a human pasting in AI since the human would mix in some non-AI in that and other posts whereas the AI agent would be all AI content.
1 Like
set up discourse captcha
Identify the user-agents in use (they often, but not always) announce themselves.
Use crawler blocks lists, ip blocking.
Captcha helps.
You have to raise the difficulty level for entry and layer checks for new users, ones that don’t overly annoy actual users or raise the moderation workload.
Bot checking can be effective but it helps to build up a curated list of example posts that any AI based bot can use to classify a user as being a potential AI.
Welcome to the new digital era, ain’t it grand 
1 Like
This is already happening.
1 Like