Curious if anyone has gotten this to work with ollama locally?

[afbeelding] hendersj: FinalDestination::SSRFDetector::DisallowedIpError (FinalDestination: all resolved IPs were disallowed) lib/final_destination/ssrf_detector.rb:105:in 'lookup_and_filter_ips' lib/final_destination/http' That is our default SSRF protection kicking in. You can add exception…

I am also trying to get this to work with ollama, it seems that the API that is used from the Discourse AI plugin is not compatible with Ollama and any settings I change do not change the API request. This is what works with ollama: curl http://192.168.1.2:11434/api/generate -d '{ …

Apparently I spoke too soon, if I do not have any settings in the Discourse AI plugin set and I follow the RAG instructions in this post I do get responses in the AI chat bot from Ollama!

It works just fine with ollama, we have multiple people on the team using it.

Cool. Is there a guide somewhere that we can follow on how to implement it? I’m more interested in the summarization and other functions than the chatbot. ETA: This configuration doesn’t work: <a class="lightbox" href="https://global.discourse-cdn.com/meta/original/4X/e/8/8/e88565c342ea1b825af2514e63b8d8173c98db3b.png" data-download-href="/uploads/short-url/xaYzI7cqt1lBNnezzL2BsWTNN5p.png?dl=1" title="The image shows a configuration screen for an AI model named "olllama" hosted by OpenAI, with fields filled in for model ID, provider, URL, and API key, as well as options for tokenizing prompts and enabling visualization. (Captioned by AI)" rel="noopener nofollow ugc">[The image shows a configuration screen for an AI model named "olllama" hosted by OpenAI, with fields…

Set the URL to http://localhost:11434/v1/chat/completions

[afbeelding] Falco: http://localhost:11434/v1/chat/completions The test still fails with the internal server error, same log message as well - a NameError saying that ‘tokenizer’ is an undefined local variable.

Try saving the model as is, refreshing the page and the coming back via the edit LLM button and running a new test.

Same result - I’ve cycled through that a few times, but just tried again. Did the install the usual way - added it to my app.yml file and ran ./launcher rebuild app The line I added was: hooks: after_code: - exec: cd: $home/plugins cmd: - sudo -E -u discourse git c…

I will get my local ollama setup back tomorrow and report here.

I did: ollama serve ollama run phi4 # test curl http://localhost:11434/v1/chat/completions \ -H "Content-Type: application/json" \ -d '{ "model": "phi4", "messages": [ { "role": "system", …

Discourse AI aan het werk krijgen met Ollama lokaal

Ondersteuning

hendersj 20 februari 2025 om 20:43 14

Cool, that did it - I did it via settings rather than the ENV variable, but the test passed now. Thanks again for all the help!

How to use internal AI endpoints?

Topic		Antwoorden	Weergaven
Discourse AI with local ollama Internal Server Error Bug ai	1	119	27 december 2025
Local Ollama is not working with the Plugin Support ai	3	279	15 oktober 2025
Internal Server Error 500- Manual configuration [ Discourse AI] Support ai	7	278	5 september 2025
Inquiry About AI Plugin Options Support ai	6	185	24 november 2025
Self-Hosting an OpenSource LLM for DiscourseAI Self-Hosting ai	6	3754	20 januari 2026

Discourse AI aan het werk krijgen met Ollama lokaal

Gerelateerde topics