I’m setting up Discourse AI on my forum and have an AI Bot/Agent working with Gemini 2.5 Flash via LiteLLM and Google Vertex AI. The bot is working, but I have a problem with its scope. For example, my forum is a business-focused community. If I ask the bot: “Who owns Uber?” it answers the que…

Yeah, after a conversation gets deep and you chain it, you can get it to keep on going. Not a worry for us as we host the models ourselves, so we don’t pay per token anyway. We also analyze all conversations on Ask daily and can ban any bad actors. The forum moderation flow is still the same. If yo…

Have you taken a look at Agents? Perhaps the Forum Researcher or Forum Helper Agents would be a better fit, as they are tuned to work with the forum specifically. Or is that what you are already using?

Forum Helper also has this problem: [image]

Hmm… then perhaps you might want to make your own agent with a customized system prompt to not respond to queries outside of your forum’s scope.

Here’s what I see today if I try this on ask.discourse.com Thanks for the question! Since you asked on a Discourse support channel, I’ll answer in the context of how language models power Discourse’s AI features — but let me know if you actually meant a general technical explanation of how LLMs wo…

The “Creative” agent you used in the test is our “no system prompt” agent, that just passes the request to the underlying LLM. You will want to craft a new agent, with a system prompt that specifies how and when to answer on your own forum. That’s what we did on ask.discourse.com as mentioned by @…

Although prompts can influence an agent’s behavior, they aren’t always reliable. I was able to trick the agent at ask.discourse.com into answering a few off-topic questions. [image]

(This is probably one of those situations where 100% enforcement would cause more inconvenience than benefit. )

How can I restrict an AI Agent to answer only questions related to my forum?

Support

Karthik_K1 (Karthik K) August 10, 2026, 9:31am 3

Forum Helper also has this problem:

Topic		Replies	Views
You can now use Discourse to power your own AI Q&A homepage Announcements ai	3	187	September 24, 2026
Why is my AI forum helper struggling to answer questions? Support ai , ai-bot	3	587	September 15, 2025
AI bot - Agents Site Management how-to , ai , ai-bot	26	4483	April 15, 2026
Email my forum? Feature ai	6	277	October 9, 2024
Introducing AI Bot 🤖 Blog	0	1009	October 25, 2023

How can I restrict an AI Agent to answer only questions related to my forum?

Related topics