I have set up the LLM, embedding, and persona features; however, my prompt is not providing the expected responses from the questions and answers or the available wiki resources within our community. Self-Hosted LLM: mistral:latest Self-Hosted Embedding: all-minilm:latest Persona: [image] [ima…

[صورة] viswanatha: Self-Hosted LLM: mistral:latest What exact Mistral model is this? [صورة] viswanatha: however, my prompt is not providing the expected responses Can you share the prompt? [صورة] viswanatha: [image] You can add Search as a “Forced Tool” for the first interact…

@Falco , The below are the details for tailing reply: What exact Mistral model is this? LLM Model : mistral:latest Link: The model at https://ollama.com/library/mistral:latest is: Mistral 7B v0.3 — a 7 billion parameter open-source model released by Mistral AI. Can you share the prompt? Sy…

[صورة] viswanatha: Mistral 7B v0.3 — a 7 billion parameter open-source model released by Mistral AI. I’m afraid a rehashed 2023 model won’t make the cut here. Also, from Ollama own documentation for this model, it only supports tool calling on the raw API, which is not what we use. Overall, …

Hi @Falco , and afraid, thank you for the Inputs. We will check and update you further.

@Falco Facing 502 error while enabling LLM. Please find the Logs below [image] [image] Message Unicorn worker received USR2 signal indicating it is about to timeout, dumping backtrace for main thread config/unicorn.conf.rb:203:in `backtrace' config/unicorn.conf.rb:203:in `block (2 levels) in r…

Set provider as OpenAI if you are using the OpenAI compatible API of Ollama.

@Falco I have tired with openAI provider still issue is persists. Message Unicorn worker received USR2 signal indicating it is about to timeout, dumping backtrace for main thread config/unicorn.conf.rb:203:in `backtrace' config/unicorn.conf.rb:203:in `block (2 levels) in reload' /var/www/discours…

Can your Discourse container access the service in the port 11434? If it’s running on the host you need to provide a way for the network cross the container boundary.

Yes, I was able access one of the LLM model ealier with same port with Discourse container

[صورة] Falco: Can your Discourse container access the service in the port 11434? If it’s running on the host you need to provide a way for the network cross the container boundary. Could you please help on this and may I know the minimum RAM requirment, where this LLM is running.

دعم روبوت الذكاء الاصطناعي للإعداد لمنتدى مجتمع الدعم بأحدث إصدار من Discourse

الدعم

viswanatha (P Viswanatha Reddy) 4 نوفمبر 2025، 7:56م 11

هل يمكنك المساعدة في هذا، وما هو الحد الأدنى لمتطلبات ذاكرة الوصول العشوائي (RAM) حيث يعمل هذا النموذج اللغوي الكبير (LLM)؟

الموضوع		الردود	مرات العرض
Chat with forum via the AI Support ai , ai-bot	5	853	15 أغسطس 2023
Discourse AI - AI Bot - a glimpse of capabilities General ai , ai-bot	4	1323	22 نوفمبر 2023
Discourse AI - AI bot Site Management ai , ai-bot , how-to	55	16876	1 مارس 2026
Enhance or create a different AI bot to help Discourse developers Feature ai , ai-bot	0	354	20 أغسطس 2023
[Ai Bot] Add user token tracking, custom AI personas, max context posts, document loading, custom API URLs, and localized chat titles Feature ai-bot , ai	2	543	22 مارس 2024

دعم روبوت الذكاء الاصطناعي للإعداد لمنتدى مجتمع الدعم بأحدث إصدار من Discourse

الموضوعات ذات الصلة