Curious if anyone has gotten this to work with ollama locally?

[image] hendersj: FinalDestination::SSRFDetector::DisallowedIpError (FinalDestination: all resolved IPs were disallowed) lib/final_destination/ssrf_detector.rb:105:in 'lookup_and_filter_ips' lib/final_destination/http' That is our default SSRF protection kicking in. You can add exceptions to …

I am also trying to get this to work with ollama, it seems that the API that is used from the Discourse AI plugin is not compatible with Ollama and any settings I change do not change the API request. This is what works with ollama: curl http://192.168.1.2:11434/api/generate -d '{ …

Apparently I spoke too soon, if I do not have any settings in the Discourse AI plugin set and I follow the RAG instructions in this post I do get responses in the AI chat bot from Ollama!

It works just fine with ollama, we have multiple people on the team using it.

Cool. Is there a guide somewhere that we can follow on how to implement it? I’m more interested in the summarization and other functions than the chatbot. ETA: This configuration doesn’t work: <a class="lightbox" href="https://global.discourse-cdn.com/meta/original/4X/e/8/8/e88565c342ea1b825af2514e63b8d8173c98db3b.png" data-download-href="/uploads/short-url/xaYzI7cqt1lBNnezzL2BsWTNN5p.png?dl=1" title="The image shows a configuration screen for an AI model named "olllama" hosted by OpenAI, with fields filled in for model ID, provider, URL, and API key, as well as options for tokenizing prompts and enabling visualization. (Captioned by AI)" rel="noopener nofollow ugc">[The image shows a configuration screen for an AI model named "olllama" hosted by OpenAI, with fields…

Set the URL to http://localhost:11434/v1/chat/completions

[image] Falco: http://localhost:11434/v1/chat/completions The test still fails with the internal server error, same log message as well - a NameError saying that ‘tokenizer’ is an undefined local variable.

Try saving the model as is, refreshing the page and the coming back via the edit LLM button and running a new test.

Same result - I’ve cycled through that a few times, but just tried again. Did the install the usual way - added it to my app.yml file and ran ./launcher rebuild app The line I added was: hooks: after_code: - exec: cd: $home/plugins cmd: - sudo -E -u discourse git c…

I will get my local ollama setup back tomorrow and report here.

I did: ollama serve ollama run phi4 # test curl http://localhost:11434/v1/chat/completions \ -H "Content-Type: application/json" \ -d '{ "model": "phi4", "messages": [ { "role": "system", …

Getting discourse ai to work with ollama locally

Support

hendersj February 20, 2025, 8:43pm 14

Cool, that did it - I did it via settings rather than the ENV variable, but the test passed now. Thanks again for all the help!

How to use internal AI endpoints?

Topic		Replies	Views
Discourse AI with local ollama Internal Server Error Bug ai	1	119	December 27, 2025
Local Ollama is not working with the Plugin Support ai	3	279	October 15, 2025
Internal Server Error 500- Manual configuration [ Discourse AI] Support ai	7	278	September 5, 2025
Inquiry About AI Plugin Options Support ai	6	185	November 24, 2025
Self-Hosting an OpenSource LLM for DiscourseAI Self-Hosting ai	6	3748	January 20, 2026

Getting discourse ai to work with ollama locally

Related topics