What's next for Toxicity detection in Discourse AI?

Today we are announcing good bye to the Discourse AI - Toxicity module :wave: in favor of Discourse AI Post Classifier - Automation rules, leveraging the power of Large Languge Models (LLMs) to provide a superior experience.

:information_source: This will be a beta experience so expect changes to occur to the feature.

Why are we doing this?

Previously using the Toxicity module meant…

  • You were stuck using a single pre-defined model
  • No customization for your community-specific needs
  • Confusing threshold metrics
  • Subpar performance

LLMs have come a long way and can now provide a better performing and customizable experience.

Whats new?

Discourse AI Post Classifier - Automation rule can be used to triage posts for Toxicity (amongst other ways) and enforce communities to specific code of conducts. This means…

  • Multiple LLMs supported for different performance requirements
  • Easy to define what and how content should be treated
  • Customizable prompts for community-specific needs
  • Flag content for review

and much more.

To assist with the transition we have already written out 2 guides

What happens to Toxicity?

This announcement should be considered very early, until we are ready to decommission you can continue to use Toxicity. When we do it, we will be decommissioning the module and removing all code from the Discourse AI plugin and associated services from our servers.

6 Likes

Is there a cut-off date for the Toxicity module?

3 Likes

We haven’t picked a specific date but are currently working on getting this done soon

2 Likes

This is extremely relevant to an article I’m writing for Community Leaders Institute right now, to my Ph.D on toxicity, and more. Would you all be willing to do a behind-the-scenes interview on this system for my YouTube channel as part of my series on inoculating online communities from toxicity? It is also doubling as an academic endeavor for my Ph.D.

You up for that?

2 Likes

Thank you for thinking about Discourse for your YouTube channel! Could you please email more details to mae@discourse.org about what exactly the behind the scenes interview would entail and what’s needed from our end?

2 Likes

FYI about the following change

2 Likes

Thanks Mae! I’ve followed up!

1 Like