I have a question regarding the AI plugin. Currently, I only see OpenAI as an option. Is it possible for us to use a local model, such as Ollama, or another program that lets us host our own models? This would help us save on costs since the tokens would be free.

See Discourse AI - Large Language Model (LLM) settings page . Also look at Getting discourse ai to work with ollama locally and Self-Hosting an OpenSource LLM for DiscourseAI .

Yes, the plugin is completely provider agnostic, you may use it with a local LLM out of the box.

Note if you are looking for free openrouter always have a few models that are free and decent, for example grok 4.1 fast a super competent model is free today (and this changes every few days). This is fully supported in Discourse AI. Local models may work but generally are pretty weak so your res…

Not to mention Gemini… IMO the free plan is very generous.

if I can usen local LLM how do I

how do I use gemini on my fourm please

استفسار حول خيارات إضافات الذكاء الاصطناعي

الدعم

beitmenotyou (Michael) 24 نوفمبر 2025، 10:35ص 5

إذا كان بإمكاني استخدام نموذج لغة كبير (LLM) محلي، فكيف أفعل ذلك؟

الموضوع		الردود	مرات العرض
Getting discourse ai to work with ollama locally Support ai	13	606	20 فبراير 2025
Discourse AI with local ollama Internal Server Error Bug ai	1	110	27 ديسمبر 2025
How to configure Discourse to use a locally installed LLM? Support ai	7	314	3 يونيو 2025
Discourse AI plugin: missing model discovery & sensible defaults (any plans or community plugins?) Feature ai	4	102	3 فبراير 2026
Create custom LLM plugin or any other option? Support	4	184	25 فبراير 2025

استفسار حول خيارات إضافات الذكاء الاصطناعي

الموضوعات ذات الصلة