We are exploring Discourse AI to provide a conversational assistant within our Discourse forum for helping users with navigation, features, categories, topics, and general forum-related questions.
We have access to our organization’s own LLM APIs for GPT and Claude, and we would like to understand how these models can be configured as providers within Discourse AI. Our goal is to use the LLM capabilities to build a more contextual conversational assistant within our Discourse
Current LLM Configuration
We currently have access to an OpenAI-compatible internal API endpoint:
We are particularly interested in guidance from anyone who has configured Discourse AI with an enterprise/internal OpenAI-compatible API gateway rather than directly using OpenAI’s public API.
Any configuration examples or recommendations would be greatly appreciated.
In the admin panel, under AI-LLM-Unconfigured LLM Templates, select GPT-5.6 Sol, and then enter the two pieces of information provided by the third-party API: