Create custom LLM plugin or any other option?

Product Support

AI-generated summary

In a Support discussion titled “Create custom LLM plugin or any other option?”, Wurzelseppi asks if it’s possible to create a custom LLM plugin for their corporate Discourse board, which cannot use public LLMs like ChatGPT. Their internal AI service uses a proprietary API requiring both API keys and OIDC-based authentication. satonotdead suggests using the existing plugin’s support for custom models/endpoints, or forking it for advanced needs. pfaffman encourages checking if the built-in AI plugin already supports their use case. sam confirms that if the internal API follows OpenAI-style interfaces, Discourse AI can be used out-of-the-box by defining a custom LLM. Wurzelseppi appreciates the help but expresses concern about the complex authentication (OIDC + API key), asking if customization of request handling is possible without forking. The consensus implies that while basic integration may work, advanced auth requirements likely necessitate forking and custom development.

1

Hi all,

we´re hosting an discourse board within our corporate network. We can´t integrate ChatGPT or any other public LLM, but there is a big initiative in our company that creates an internal service for AI modules (including GPT).
The have their own API, though, and I wanted to ask if it would be possible to write an custom LLM plugin?
Or what other option do we have ?

The calls to this internal API have to be authenticated, and the API itself needs another API key, so there are several mandantory information that have to be provided upfront.

Any help would be much appreciated.

Thanks and Greetings,

WS

2

You can use custom models and/or endpoints with the current plugin.

Then, if you need to add more functionality, you can fork and maintain your own plugin as well.

3

Yes, but have you installed the AI plugin to see what it supports already?

4

As long as your internal endpoints use a OpenAI type of API interfaces you can use Discourse AI as is and just define a custom LLM.

5

I´ll try it out. One big concern I´m having, though, is the authentication thing.
It´s not only API key, but also OIDC based (corporate policy stuff :slight_smile: )…

Meaning I would need to somehow customize the way the board makes requests agains this API. Is that possible without forking and doing it myself ?

Thanks folks, you´re awsome time and again :+1: