AI triage is designed to enhance the management and moderation of forum posts by automating the process of classifying posts.
Please note that this feature requires both the discourse-automation and discourse-ai plugins to function.
Use Cases
-
Automated Post Categorization: AI triage can automatically categorize topics based on their content. This is particularly beneficial for large forums where manual categorization can be time-consuming. You can apply the rules to a subset of topics (first topic only or topics posted to particular categories)
-
Post Tagging: AI triage can assign specified tags to posts. This feature aids in the better organization of posts and makes searching and retrieving topics more efficient.
-
Automated Responses: AI triage can generate replies to posts using predefined responses. This is useful for addressing frequently asked questions or common queries, sending spam to junk categories, and more.
-
Topic Hiding: AI triage can hide topics based on certain criteria. This can be used for managing spam or inappropriate content.
-
NSFW/Toxicity/Spam detection
How It Works
AI triage uses AI models to analyze the content of the posts. Based on this analysis if the model returns specific text, it performs the specified actions. These actions include moving the post to a specified category, adding tags, replying with a predefined response, and hiding the topic. LLMs that can be used are populated from Discourse AI - Large Language Model (LLM) settings page
Screenshots
Configuration
To configure AI triage, you need to specify certain parameters:
- System Prompt: This is the message that the AI model will use as a context for generating responses.
- Search for Text: If the following text appears in the LLM reply, apply the actions below.
- Model: This is the AI model that will be used for analysis. You can choose LLMs set up via the Discourse AI - Large Language Model (LLM) settings page.
- Category: This is the category to which the post will be moved if the specified text is found.
- Tags: These are the tags that will be added to the post if the specified text is found.
- Hide Topic: If this option is enabled, the topic will be hidden if the specified text is found.
- Flag post: If this is enabled, the topic will be flagged for the review queue for moderators, staff and admins to take action
- Flag type: Option to either mark flagged post as spam and hide it, or send it to the review queue
- Reply: This is the predefined response that will be posted if the specified text is found.
- Reply User: This is the user that will be mentioned in the canned reply.
Caveats
- LLM calls can be expensive. When applying a classifier be careful to monitor costs and always consider only running this on small subsets.
- The particular use case we tested (and run in production for a customer) is the classification of first topics of a user.
- We recommend you use AI bot to help author the system prompt.
Last edited by @Saif 2024-10-31T23:34:03Z
Check document
Perform check on document: