# Discourse AI - סינון AI

**URL:** https://meta.discourse.org/t/discourse-ai-ai-triage/281227
**Category:** Site Management
**Tags:** automation, how-to, ai
**Created:** [6 באוקטובר,‏ 2023,‏ 12:23am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227 "2023-10-06T00:23:29Z")
**Posts on this page:** 20
**Page:** 2

<div class="post-metadata">

### Author: ![Saif](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/saif/32/318253_2.png) [@Saif](https://meta.discourse.org/u/Saif)
#### Post date: [22 באוגוסט,‏ 2024,‏ 2:44am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/24 "2024-08-22T02:44:03Z")

</div>

Just following up here to note that AI triage **no longer** needs the following thanks to @Roman work on improving the prompts

> [@sam](#):
>
> It should contain a `%%POST%%` placeholder that will be replaced with the post content.

---

<div class="post-metadata">

### Author: ![Samantha\_Venia\_Logan](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/samantha_venia_logan/32/442576_2.png) [@Samantha\_Venia\_Logan](https://meta.discourse.org/u/Samantha_Venia_Logan)
#### Post date: [26 באוגוסט,‏ 2024,‏ 4:54am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/25 "2024-08-26T04:54:14Z")

</div>

hey all! This is more of a kudos comment to becauseI wanted to first thank you all for supplying the information provided here in addition to the posts that I had perused regarding this feature.

It provided some much-needed context into how this work has been implemented. I am currently studying the measurement and identification of online Toxicity models in enterprise, social media, and especially smaller or growing communities and I have a lot of questions but nothing huge to report as of yet.

---

<div class="post-metadata">

### Author: ![loginerror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/loginerror/32/156605_2.png) [@loginerror](https://meta.discourse.org/u/loginerror)
#### Post date: [26 באוגוסט,‏ 2024,‏ 7:47am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/26 "2024-08-26T07:47:27Z")

</div>

Quick follow-up - does it mean that the existing prompts that were already running should be updated?

---

<div class="post-metadata">

### Author: ![Saif](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/saif/32/318253_2.png) [@Saif](https://meta.discourse.org/u/Saif)
#### Post date: [26 באוגוסט,‏ 2024,‏ 5:15pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/27 "2024-08-26T17:15:55Z")

</div>

> [@loginerror](#):
>
> Quick follow-up - does it mean that the existing prompts that were already running should be updated?

Yes, existing prompts should be updated now to reflect the changes

---

<div class="post-metadata">

### Author: ![Overgrow](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/overgrow/32/478189_2.png) [@Overgrow](https://meta.discourse.org/u/Overgrow)
#### Post date: [12 בספטמבר,‏ 2024,‏ 11:52am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/28 "2024-09-12T11:52:58Z")

</div>

AI Triage is fantastic! I’m looking forward how far we can go with it from classical ‘bag of words” algorithm. Post classifier is a great feature. I wonder if it there are plans to allow to use it with post approval queue. ( `approve post count, approve unless allowed groups`).

So basically use a classifier not only to add to queue for review but to automatically approve or reject from the queue. (I don’t mean handling flags only approvals)

I see AI post triaging and post review queue as complementary.

---

<div class="post-metadata">

### Author: ![RGJ](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/rgj/32/523185_2.png) [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [25 בספטמבר,‏ 2024,‏ 9:37am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/31 "2024-09-25T09:37:50Z")

</div>

So to add tags or to change categories, there are currently the following options (correct me if I am wrong)

- the user uses the [AI helper](https://meta.discourse.org/t/discourse-ai-ai-helper/283943) to suggest tags and category from within the composer based on nearest neighbor embedding vectors, comparing it with previous posts.
- the administrator sets up a separate AI post classifier that runs the topic through an LLM for every possible tag and every possible category, which adds the tag or changes the category when the LLM output says so. It will not add arbitrary tags, each classifier will only add a specific tag yes or no. This is not only cumbersome to set up and maintain, it is also expensive because you need to run them all.

_What I would like to have_ is a classifier that takes an instruction like

> You are a tagging assistant for a forum. The forum is about X, Y and Z.
> 
> Your task is to tag forum posts with one or more of the following tags:
> 
> - one tag that specifies whether the post is selling for something or looking for something. Tags: for\_sale, wanted, advice
> - one tag that specifies the kind of item the post is about: cars, services, tickets, kids\_stuff, home\_and\_garden, other.
> 
> If you come across a message that is NSFW, tag it NSFW.
> 
> You can also set actions in order to moderate a post.  
> If you come across a message that is on topic for this forum but might be seen as offensive, set the action to ‘flag’.  
> If you come across a message that is off topic, set the action to ‘hide’

This can then be accompanied by the great new OpenAI [structured outputs](https://platform.openai.com/docs/guides/structured-outputs) option to return a json structure that specifies the tags to be added or the action to be taken, which will then be processed by the classifier.

Is anything like this on the roadmap and/or is a PR welcome? Or would this be plugin territory?

---

<div class="post-metadata">

### Author: ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2 באוקטובר,‏ 2024,‏ 10:50pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/34 "2024-10-02T22:50:14Z")

</div>

I think the safest way to go about this would be to define a brand new automation for this. It is structurally very different to the current one.

I think we would be open to a well tested PR to Discourse AI.

Keep in mind Completion Prompt in AI does not support structured outputs at the moment, this concept would need to be added and implemented for OpenAI models, we have a ton of models, many do not have native support, I would be open for a PR just to provide OpenAI support for starters as long as it is not confusing to end users and we allow them to select a model not supporting the feature.

It is a reasonably big change though, but if you are feeling brave… go for it.

Would recommend going about it in multiple PRs starting from giving structured output support to completion prompts (tested)

---

<div class="post-metadata">

### Author: ![Frank\_Sikora](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/frank_sikora/32/467905_2.png) [@Frank\_Sikora](https://meta.discourse.org/u/Frank_Sikora)
#### Post date: [27 בנובמבר,‏ 2024,‏ 5:40pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/38 "2024-11-27T17:40:02Z")

</div>

In the process of creating an ‘Auto-tag posts’ automation, however I am not able to select a tag that has been added to a tag group. Please let me know if there are any workarounds for this. I prefer to keep the existing tag group. Thanks!

---

<div class="post-metadata">

### Author: ![BrianC](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/brianc/32/487568_2.png) [@BrianC](https://meta.discourse.org/u/BrianC)
#### Post date: [5 בינואר,‏ 2025,‏ 5:15pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/43 "2025-01-05T17:15:05Z")

</div>

Hey everyone,

Do I understand this correctly? If I have 50 categories I am going to use AI triage to auto categorize topics into those categories I will need 50 unique automations to accomplish?

Is the only time a call will be made to LLM is when any and all new topics are created for that initial post? Seems the AI usage is not excessive for this scenario.

I think I read that someone was considering another approach for this but might be consider only idea stage I suppose.

---

<div class="post-metadata">

### Author: ![BrianC](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/brianc/32/487568_2.png) [@BrianC](https://meta.discourse.org/u/BrianC)
#### Post date: [6 בינואר,‏ 2025,‏ 5:04am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/44 "2025-01-06T05:04:33Z")

</div>

I think the answer to my question is it depends on how granular you want to auto categorize.

Perhaps someone can answer when using automation to automatically categorize topics does the search input box being matched take priority over using AI?

In other words if I set Banana as the search term in automation and a user creates a topic using Banana within the post, Match, No AI called. Categorize as banana.

If the user creates topic which references yellow fruit monkeys eat, No Match, AI prompt runs and may determine that description is a banana 🍌.

For this scenario Banana would also be an existing category.

---

<div class="post-metadata">

### Author: ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)
#### Post date: [6 בינואר,‏ 2025,‏ 6:07am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/45 "2025-01-06T06:07:03Z")

</div>

some of this ties back to what @RGJ talked about and some ideas I have been kicking around with @Falco .

I am kind of opening up to allowing a persona to act as an agent, then you could let the agent loose to do various things for you via tools, like categorize topics and so on.

The mechanics here are all in the air, but we are thinking about this.

50 automations is clearly a terrible solution.

---

<div class="post-metadata">

### Author: ![David\_Ghost](https://avatars.discourse-cdn.com/v4/letter/d/c37758/32.png) [@David\_Ghost](https://meta.discourse.org/u/David_Ghost)
#### Post date: [14 בינואר,‏ 2025,‏ 5:31pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/46 "2025-01-14T17:31:54Z")

</div>

Hello

Can AI Triage perform searches? I intend to use a prompt that avoids topics with similar titles if the creation date of the other topic is less than one day old. Is this possible with AI Triage?

---

<div class="post-metadata">

### Author: ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)
#### Post date: [14 בינואר,‏ 2025,‏ 10:56pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/47 "2025-01-14T22:56:15Z")

</div>

Not at the moment, it sounds like you are describing “agent” like behaviors. This is certainly something we are thinking about!

---

<div class="post-metadata">

### Author: ![NateDhaliwal](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/natedhaliwal/32/313494_2.png) [@NateDhaliwal](https://meta.discourse.org/u/NateDhaliwal)
#### Post date: [28 בינואר,‏ 2025,‏ 5:31am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/48 "2025-01-28T05:31:02Z")

</div>

Wow, this works like a charm!  
I’m seeking advice: what should I put as the cap on the number of tokens? This is for a low-traffic forum.

---

<div class="post-metadata">

### Author: ![Saif](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/saif/32/318253_2.png) [@Saif](https://meta.discourse.org/u/Saif)
#### Post date: [13 במרץ,‏ 2025,‏ 4:07pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/49 "2025-03-13T16:07:44Z")

</div>

Copying this over here for relevancy

> [@Discourse AI - AI triage using Agent](https://meta.discourse.org/t/discourse-ai-ai-auto-responder/356375/4):
>
> Also worth noting, llm triage can also respond using a persona now, this means you can support custom replies based on triage This automation unconditionally respond. Triage will conditionally respond

---

<div class="post-metadata">

### Author: ![kuaza](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/kuaza/32/264151_2.png) [@kuaza](https://meta.discourse.org/u/kuaza)
#### Post date: [31 במאי,‏ 2025,‏ 10:55pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/50 "2025-05-31T22:55:14Z")

</div>

אני חושב שצריך לשפר את התכונה הזו. אני מצפה שהבינה המלאכותית תמיין נושאים באופן אוטומטי ותתמוך בהם בתגיות מתאימות. זה לא אוטומטי לחלוטין במצבו הנוכחי (או שלא הבנתי את זה). לדוגמה, אנחנו צריכים לבחור קטגוריה ספציפית. בעצם, יש לנו בינה מלאכותית, למה היא לא עושה הכל? זה יהיה נוחות גדולה למשתמשים ולמנהלים. אם הקטגוריות והתגיות היו מאורגנות אוטומטית על ידי בינה מלאכותית, יכולנו אפילו לכלול את הכותרת. אז הדבר היחיד שמשתמשים יצטרכו לעשות זה לכתוב מה שהם רוצים להגיד. זה יחסוך לנו שניות וזה יהיה נוחות גדולה למשתמשים.

---

<div class="post-metadata">

### Author: ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)
#### Post date: [31 במאי,‏ 2025,‏ 11:01pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/51 "2025-05-31T23:01:26Z")

</div>

> [@kuaza](#):
>
> Actually, we have AI, why doesn’t it do everything?

The fundamental answer is that “everything” means different things to different people. Defaults help but finding a recipe that fits perfectly for 99% of people is very very hard. All communities are somewhat different.

---

<div class="post-metadata">

### Author: ![kuaza](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/kuaza/32/264151_2.png) [@kuaza](https://meta.discourse.org/u/kuaza)
#### Post date: [31 במאי,‏ 2025,‏ 11:10pm UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/52 "2025-05-31T23:10:02Z")

</div>

Our goal is to make people’s job easier. So let’s automate this, and when necessary, administrators or authorized users can edit it and give feedback to AI. This feature can remain the same, but we need to think about completely AI-driven category and tag determination.

Actually, my expectation is that people can easily create new topics like here [https://ask.discourse.com/](https://ask.discourse.com/) and not waste time with categories, titles or tags. These can be edited later if desired, but we need to think about the benefits of providing this convenience to users.

---

<div class="post-metadata">

### Author: ![pfaffman](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/pfaffman/32/120154_2.png) [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [1 ביוני,‏ 2025,‏ 1:23am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/53 "2025-06-01T01:23:01Z")

</div>

> [@kuaza](#):
>
> and not waste time with categories, titles or tags

The likelihood that ai can do this well is slim. If the person writing the topic doesn’t know enough about the community to know what topic it should go in, or what a reasonable title is, it’s unlikely that they be posting anything valuable to the community.

Where does it stop for you? Why make users write anything at all? Shouldn’t the AI generate the topics and the replies?

---

<div class="post-metadata">

### Author: ![satonotdead](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/satonotdead/32/447830_2.png) [@satonotdead](https://meta.discourse.org/u/satonotdead)
#### Post date: [1 ביוני,‏ 2025,‏ 4:31am UTC](https://meta.discourse.org/t/discourse-ai-ai-triage/281227/54 "2025-06-01T04:31:29Z")

</div>

אני מסכים עם התגובות האחרונות, אבל קטלוג אוטומטי יכול להיות תכונה טובה להתנסות בה.

אולי אפשרות להפעיל/לכבות את התכונה תתאים לצרכים השונים של אנשים שונים שסם ציין.

ממשק המשתמש/חוויית המשתמש (UI/UX) לבחירת הקטגוריות קשה למשתמשים לא טכניים. אף אחד לא רוצה לגלול בתפריטים נפתחים ו/או להשתמש בעכבר + מקלדת, אלא רק להקליד ולפרסם את ההודעות שלו.

[Previous page](https://meta.discourse.org/t/discourse-ai-ai-triage/281227.md?page=1)

[Next page](https://meta.discourse.org/t/discourse-ai-ai-triage/281227.md?page=3)
