Hey guys, This is about a selfhosted instance I´ve activated the Discourse AI Plugin and had a few problems there. Working in an enterprise environment and AI access is though an internal endpoint with additional authentication. I implemented an AWS API Gateway endpoint with a Lambda, that tak…

[صورة] Wurzelseppi: AI access is though an internal endpoint with additional authentication. Our test endpoint is a bit misleading and this is something I would like to fix. We currently only test “non streaming” endpoints. “streaming” is not tested. Does everything work if you disable stre…

Hey @sam , I disabled the streaming (hard coded) in my LAMBDA while passing the request on. Thing is, that the LAMBDA doesn´t even get triggered by the summarization API (i see no requests). The LLM Test issues a call, but the summarization button in a topic doesn´t. Nothing, no errors (i switche…

[صورة] Wurzelseppi: The <a class="lightbox" href="https://global.discourse-cdn.com/meta/original/4X/7/f/4/7f4c5bc9803eaa57ba51b57ded202902bff078e8.png" data-download-href="/uploads/short-url/ia8eDQlD0H5uomp8fQ9Trm873Bu.png?dl=1" title="The image depicts a settings page for Large Language Models (LLMs) in a software application, detailing how they are used and listing a configured LLM named GPT-4o, associated with the vLLM provider. (Captioned by AI)">[The image depicts a settings page for Large Language Models (LLMs) in a software application, detailing how they are used and listing a configured LLM named GPT-4o, associated with the vLLM provider. (Captioned by AI)] Why is the provider set to vLLM if it is an Ope…

Hi, I´ve tried many different engines. Sorry, the screenshot was misleading. I´ve tried OpenAI also … This is the answer from the endpoint which I send 1:1 back to discourse instance. With this I´m getting an “Internal Server Error” @ discourse (not sure why, because the test worked until this mo…

Hey guys, The translator and Forum Helper are working now, but the Summarize Button doesn´t trigger anything. I´m not seeing anything in my CloudWatch logs that any request has been triggered from discourse. The summarizer is configured with the Summarize Persona, and the Perso is using the LLM e…

New insight: Some topics can be summarized, some not… It seems that the new ones can be summarized. And another question: When I have a topic with pictures in it, and don’t have any image-recognizing AI in place, is this a problem?

[صورة] Wurzelseppi: DiscourseAi::Completions::Endpoints::Vllm: status: 502 - body: {"message": "Internal server error"} That is a 502 from your own endpoint :stuck_out_tongue: [صورة] Wurzelseppi: Some topics can be summarized, some not… Topic length maybe? [صورة] Wurzelseppi: And…

Hey @Falco [صورة] Falco: Topic length maybe? But discourse even start the request, nor gives any reason (logs, …) why it doesn´t :frowning: Hard to narrow down my options [صورة] Falco: That is a 502 from your own endpoint No, it wasn´t´. I found the problem (didn´t JSON.stringify th…

تلخيص الموضوع لا يعمل :-(

الدعم

Falco (Falco) 28 مايو 2025، 3:27م 4

لماذا تم تعيين المزود على vLLM إذا كان نقطة نهاية متوافقة مع OpenAI؟

الموضوع		الردود	مرات العرض
Discourse AI - Summarize Site Management how-to , ai , ai-summarize	32	8018	5 يونيو 2025
You need to select a model before the AI Summarizer Persona works Bug ai , ai-summarize	1	120	20 يوليو 2025
Setup Inquiry: AI Summarization in Discourse & LLM Integration Support ai	10	243	6 أكتوبر 2025
Customizing AI summarizer to use non-English languages Support ai , ai-summarize	5	199	16 فبراير 2026
AI topic summarize hangs (Gemini) Support	2	105	20 مايو 2025

تلخيص الموضوع لا يعمل :-(

الموضوعات ذات الصلة