Curious if anyone has gotten this to work with ollama locally?

[изображение] hendersj: FinalDestination::SSRFDetector::DisallowedIpError (FinalDestination: all resolved IPs were disallowed) lib/final_destination/ssrf_detector.rb:105:in 'lookup_and_filter_ips' lib/final_destination/http' That is our default SSRF protection kicking in. You can add exceptio…

I am also trying to get this to work with ollama, it seems that the API that is used from the Discourse AI plugin is not compatible with Ollama and any settings I change do not change the API request. This is what works with ollama: curl http://192.168.1.2:11434/api/generate -d '{ …

Apparently I spoke too soon, if I do not have any settings in the Discourse AI plugin set and I follow the RAG instructions in this post I do get responses in the AI chat bot from Ollama!

It works just fine with ollama, we have multiple people on the team using it.

Cool. Is there a guide somewhere that we can follow on how to implement it? I’m more interested in the summarization and other functions than the chatbot. ETA: This configuration doesn’t work: <a class="lightbox" href="https://d11a6trkgmumsb.cloudfront.net/original/4X/e/8/8/e88565c342ea1b825af2514e63b8d8173c98db3b.png" data-download-href="/uploads/short-url/xaYzI7cqt1lBNnezzL2BsWTNN5p.png?dl=1" title="The image shows a configuration screen for an AI model named "olllama" hosted by OpenAI, with fields filled in for model ID, provider, URL, and API key, as well as options for tokenizing prompts and enabling visualization. (Captioned by AI)" rel="noopener nofollow ugc">[The image shows a configuration screen for an AI model named "olllama" hosted by OpenAI, with fields…

Set the URL to http://localhost:11434/v1/chat/completions

[изображение] Falco: http://localhost:11434/v1/chat/completions The test still fails with the internal server error, same log message as well - a NameError saying that ‘tokenizer’ is an undefined local variable.

Try saving the model as is, refreshing the page and the coming back via the edit LLM button and running a new test.

Same result - I’ve cycled through that a few times, but just tried again. Did the install the usual way - added it to my app.yml file and ran ./launcher rebuild app The line I added was: hooks: after_code: - exec: cd: $home/plugins cmd: - sudo -E -u discourse git c…

I will get my local ollama setup back tomorrow and report here.

I did: ollama serve ollama run phi4 # test curl http://localhost:11434/v1/chat/completions \ -H "Content-Type: application/json" \ -d '{ "model": "phi4", "messages": [ { "role": "system", …

Настройка работы Discourse AI с Ollama локально

Поддержка

Falco (Falco) Разделил(а) эту тему 07.Март.2025 15:44:17 15

3 posts were split to a new topic: How to Use Ollama With Embeddings

Тема		Ответов	Просм.
Discourse AI with local ollama Internal Server Error Bug ai	2	64	28.12.2025
Local Ollama is not working with the Plugin Support ai	4	195	15.10.2025
Internal Server Error 500- Manual configuration [ Discourse AI] Support ai	8	218	05.09.2025
Inquiry About AI Plugin Options Support ai	7	120	24.11.2025
Self-Hosting an OpenSource LLM for DiscourseAI Self-Hosting ai	7	3558	20.01.2026

Настройка работы Discourse AI с Ollama локально

Связанные темы