Discourse AI going off the rails

That is exactly the question I would be trying to run down if I were an admin following up on a report like this.

I am an admin on another Discourse hosted forum, so will do a little digging.



Also asked ChatGPT to check my reply and it added the following which I am now going to verify but wanted to pass along so you are not waiting.

From the Discourse AI documentation, administrators can inspect the configured models under:

Admin → Plugins → Discourse AI → LLMs

Discourse AI features are also backed by personas, and a persona can be configured to use a particular LLM. The current AI feature configuration can show which persona and LLM are powering a particular feature.

Useful references:

What I have not yet found is a documented way for an ordinary user to inspect a completed Help AI conversation and see the exact model that handled that specific interaction.

If someone knows whether that information is exposed to users, admins, or in the site logs for an individual request, please add it here. That would be useful for reports like this.


In reviewing the AI-generated section above, which I am leaving unchanged for transparency, I would make a few corrections.

First, I would remove the Discourse AI – AI bot link. It does not appear necessary for answering the specific question about which model is being used.

I would also remove:

What I have not yet found is a documented way for an ordinary user to inspect a completed Help AI conversation and see the exact model that handled that specific interaction.

That limitation is not especially relevant here because you noted that you are an admin, so you have access to configuration information that an ordinary user would not.

Finally, now that I know where the relevant configuration details can be found, I would also remove:

If someone knows whether that information is exposed to users, admins, or in the site logs for an individual request, please add it here. That would be useful for reports like this.

At this point, the more useful path is to inspect the Discourse AI configuration and determine which LLM are assigned to the Help AI feature.