Hi all, we´re hosting an discourse board within our corporate network. We can´t integrate ChatGPT or any other public LLM, but there is a big initiative in our company that creates an internal service for AI modules (including GPT). The have their own API, though, and I wanted to ask if it would b…

You can use custom models and/or endpoints with the current plugin. Then, if you need to add more functionality, you can fork and maintain your own plugin as well.

[image] Wurzelseppi: I wanted to ask if it would be possible to write an custom LLM plugin? Yes, but have you installed the AI plugin to see what it supports already?

As long as your internal endpoints use a OpenAI type of API interfaces you can use Discourse AI as is and just define a custom LLM.

I´ll try it out. One big concern I´m having, though, is the authentication thing. It´s not only API key, but also OIDC based (corporate policy stuff :slight_smile: )… Meaning I would need to somehow customize the way the board makes requests agains this API. Is that possible without forking and do…

Create custom LLM plugin or any other option?

Product Support

pfaffman (Jay Pfaffman) February 24, 2025, 6:55pm 3

Yes, but have you installed the AI plugin to see what it supports already?

Topic		Replies	Views
Discourse AI - Large Language Model (LLM) settings page Site Management how-to , ai	1	4798	September 30, 2024
Configure API Keys for Anthropic Integrations how-to , ai	0	1885	October 3, 2023
Discourse AI plugin with self hosted discourse site Product Support ai	2	568	July 9, 2024
ChatGPT Assistant Integration Product Support	5	1652	February 11, 2024
[Ai Bot] Add user token tracking, custom AI personas, max context posts, document loading, custom API URLs, and localized chat titles Feature ai , ai-bot	1	791	March 22, 2024

Create custom LLM plugin or any other option?

Related topics