Curious if anyone has gotten this to work with ollama locally?

[Bild] hendersj: FinalDestination::SSRFDetector::DisallowedIpError (FinalDestination: all resolved IPs were disallowed) lib/final_destination/ssrf_detector.rb:105:in 'lookup_and_filter_ips' lib/final_destination/http' That is our default SSRF protection kicking in. You can add exceptions to i…

I am also trying to get this to work with ollama, it seems that the API that is used from the Discourse AI plugin is not compatible with Ollama and any settings I change do not change the API request. This is what works with ollama: curl http://192.168.1.2:11434/api/generate -d '{ …

Apparently I spoke too soon, if I do not have any settings in the Discourse AI plugin set and I follow the RAG instructions in this post I do get responses in the AI chat bot from Ollama!

It works just fine with ollama, we have multiple people on the team using it.

Cool. Is there a guide somewhere that we can follow on how to implement it? I’m more interested in the summarization and other functions than the chatbot. ETA: This configuration doesn’t work: <a class="lightbox" href="https://global.discourse-cdn.com/meta/original/4X/e/8/8/e88565c342ea1b825af2514e63b8d8173c98db3b.png" data-download-href="/uploads/short-url/xaYzI7cqt1lBNnezzL2BsWTNN5p.png?dl=1" title="The image shows a configuration screen for an AI model named "olllama" hosted by OpenAI, with fields filled in for model ID, provider, URL, and API key, as well as options for tokenizing prompts and enabling visualization. (Captioned by AI)" rel="noopener nofollow ugc">[The image shows a configuration screen for an AI model named "olllama" hosted by OpenAI, with fields…

Set the URL to http://localhost:11434/v1/chat/completions

[Bild] Falco: http://localhost:11434/v1/chat/completions The test still fails with the internal server error, same log message as well - a NameError saying that ‘tokenizer’ is an undefined local variable.

Try saving the model as is, refreshing the page and the coming back via the edit LLM button and running a new test.

Same result - I’ve cycled through that a few times, but just tried again. Did the install the usual way - added it to my app.yml file and ran ./launcher rebuild app The line I added was: hooks: after_code: - exec: cd: $home/plugins cmd: - sudo -E -u discourse git c…

I will get my local ollama setup back tomorrow and report here.

I did: ollama serve ollama run phi4 # test curl http://localhost:11434/v1/chat/completions \ -H "Content-Type: application/json" \ -d '{ "model": "phi4", "messages": [ { "role": "system", …

Discourse AI mit Ollama lokal zum Laufen bringen

Unterstützung

Thema		Antworten	Aufrufe
Discourse AI with local ollama Internal Server Error Bug ai	1	153	27. Dezember 2025
Self-Hosting an OpenSource LLM for DiscourseAI Self-Hosting ai	12	3976	6. Juli 2026
Local Ollama is not working with the Plugin Support ai	3	305	15. Oktober 2025
Internal Server Error 500- Manual configuration [ Discourse AI] Support ai	7	309	5. September 2025
Inquiry About AI Plugin Options Support ai	6	223	24. November 2025

Discourse AI mit Ollama lokal zum Laufen bringen

Verwandte Themen