What's next for Toxicity detection in Discourse AI

Today we are announcing good bye to the Discourse AI - Toxicity module :wave: in favor of Discourse AI - AI triage, leveraging the power of Large Language Models (LLMs) to provide a superior experience.

Why are we doing this?

Previously using the Toxicity module meant…

  • You were stuck using a single pre-defined model
  • No customization for your community-specific needs
  • Confusing threshold metrics
  • Subpar performance

LLMs have come a long way and can now provide a better performing and customizable experience.

Whats new?

Discourse AI - AI triage can be used to triage posts for Toxicity (amongst other ways) and enforce communities to specific code of conducts. This means…

  • Multiple LLMs supported for different performance requirements
  • Easy to define what and how content should be treated
  • Customizable prompts for community-specific needs
  • Flag content for review

and much more.

To assist with the transition we have already written out guides

What happens to Toxicity?

This announcement should be considered very early, until we are ready to decommission you can continue to use Toxicity. When we do it, we will be decommissioning the module and removing all code from the Discourse AI plugin and associated services from our servers.

:point_right:t5: Update: Toxicity module has now been officially removed from Discourse, this includes all related site settings and features. We are now urging users to transition to using Discourse AI - AI triage and follow the guides listed above.

Business and Enterprise customers will see the following under What's New in the admin settings on their sites, allowing them to enable Discourse hosted LLMs to power AI triage at no extra cost.

6 Likes

Is there a cut-off date for the Toxicity module?

3 Likes

We haven’t picked a specific date but are currently working on getting this done soon

3 Likes

This is extremely relevant to an article I’m writing for Community Leaders Institute right now, to my Ph.D on toxicity, and more. Would you all be willing to do a behind-the-scenes interview on this system for my YouTube channel as part of my series on inoculating online communities from toxicity? It is also doubling as an academic endeavor for my Ph.D.

You up for that?

2 Likes

Thank you for thinking about Discourse for your YouTube channel! Could you please email more details to mae@discourse.org about what exactly the behind the scenes interview would entail and what’s needed from our end?

2 Likes

FYI about the following change

2 Likes

Thanks Mae! I’ve followed up!

1 Like

As a heads-up, we are now hiding site settings for enabling/disabling Toxicity and NSFW. This is our ongoing effort as we continue to deprecate the features.

If you have these features turned on, it will still operate as normal. We have NOT fully deprecated the features yet.

If you have it turned off and would like to turn it on, you will now be unable to do so.

1 Like

Hey folks just wanted to drop this update