Hi all, we´re hosting an discourse board within our corporate network. We can´t integrate ChatGPT or any other public LLM, but there is a big initiative in our company that creates an internal service for AI modules (including GPT). The have their own API, though, and I wanted to ask if it would be possible to write an custom LLM plugin? Or what other option do we have ? The calls to this internal API have to be authenticated, and the API itself needs another API key, so there are several mandantory information that have to be provided upfront. Any help would be much appreciated. Thanks and Greetings, WS

You can use custom models and/or endpoints with the current plugin. Then, if you need to add more functionality, you can fork and maintain your own plugin as well.

[תמונה] Wurzelseppi: I wanted to ask if it would be possible to write an custom LLM plugin? Yes, but have you installed the AI plugin to see what it supports already?

As long as your internal endpoints use a OpenAI type of API interfaces you can use Discourse AI as is and just define a custom LLM.

I´ll try it out. One big concern I´m having, though, is the authentication thing. It´s not only API key, but also OIDC based (corporate policy stuff :slight_smile: )… Meaning I would need to somehow customize the way the board makes requests agains this API. Is that possible without forking and doing it myself ? Thanks folks, you´re awsome time and again :+1:

לעשות תוסף LLM מותאם אישית או אפשרות אחרת?

תמיכה

pfaffman (Jay Pfaffman) 24 בפברואר,‏ 2025,‏ 6:55pm 3

Yes, but have you installed the AI plugin to see what it supports already?

נושא		תגובות	צפיות
Discourse AI - Large Language Model (LLM) settings page Site Management how-to , ai	1	4940	30 בספטמבר,‏ 2024
Configure API Keys for Anthropic Integrations how-to , ai	0	1962	3 באוקטובר,‏ 2023
Discourse AI plugin with self hosted discourse site Product Support ai	2	614	9 ביולי,‏ 2024
ChatGPT Assistant Integration Product Support	5	1706	11 בפברואר,‏ 2024
[Ai Bot] Add user token tracking, custom AI personas, max context posts, document loading, custom API URLs, and localized chat titles Feature ai , ai-bot	1	822	22 במרץ,‏ 2024

לעשות תוסף LLM מותאם אישית או אפשרות אחרת?

נושאים קשורים