Hi all, we´re hosting an discourse board within our corporate network. We can´t integrate ChatGPT or any other public LLM, but there is a big initiative in our company that creates an internal service for AI modules (including GPT). The have their own API, though, and I wanted to ask if it would b…

You can use custom models and/or endpoints with the current plugin. Then, if you need to add more functionality, you can fork and maintain your own plugin as well.

[Bild] Wurzelseppi: I wanted to ask if it would be possible to write an custom LLM plugin? Yes, but have you installed the AI plugin to see what it supports already?

As long as your internal endpoints use a OpenAI type of API interfaces you can use Discourse AI as is and just define a custom LLM.

I´ll try it out. One big concern I´m having, though, is the authentication thing. It´s not only API key, but also OIDC based (corporate policy stuff :slight_smile: )… Meaning I would need to somehow customize the way the board makes requests agains this API. Is that possible without forking and do…

Eigene LLM-Plugin erstellen oder eine andere Option wählen?

Unterstützung

sam (Sam Saffron) 25. Februar 2025 um 01:01 4

Solange Ihre internen Endpunkte OpenAI-ähnliche API-Schnittstellen verwenden, können Sie Discourse AI wie gewohnt verwenden und einfach ein benutzerdefiniertes LLM definieren.

Thema		Antworten	Aufrufe
Configure API Keys for Anthropic Integrations how-to , ai	0	1539	3. Oktober 2023
Discourse AI plugin with self hosted discourse site Support ai	2	328	9. Juli 2024
Discourse AI - Large Language Model (LLM) settings page Site Management how-to , ai	20	3596	9. Mai 2026
ChatGPT Assistant Integration Support	5	1397	11. Februar 2024
[Ai Bot] Add user token tracking, custom AI personas, max context posts, document loading, custom API URLs, and localized chat titles Feature ai , ai-bot	1	594	22. März 2024

Eigene LLM-Plugin erstellen oder eine andere Option wählen?

Verwandte Themen