We have enabled the custom LLM, but we are facing an issue when trying the chatbot. [image] Log Message (2 copies reported) Job exception: {"error":{"message":"registry.ollama.ai/library/deepseek-coder-v2:latest does not support tools","type":"api_error","param":null,"code":null}} Backtrace /…

If the model does not have native tool support, you can always use the XML alternative, which includes them in the prompt: [Screenshot 2025-09-05 at 7.57.08 PM]

curl -X POST http://localhost:11434/v1/chat/completions -H "Content-Type: application/json" -d '{ "model": "deepseek-coder-v2:latest", "messages": [ { "role": "system", "content": "You are a helpful assistant." }, { "role": "user", "content": "What is the late…

Looks like this is the key error: deepseek-coder-v2:latest does not support tools looking at the list of models here: deepseek-coder · Ollama it doesn’t seem like deepseek-coder-v2 supports tools — you’d either need to remove tools from your persona or switch to a model with tool calling like dee…

When we execute the CURL command with the inputs, it produces the output without any issues. We have not made any customizations in the persona and respective settings. [圖片] deepseek-coder-v2 An open-source Mixture-of-Experts code language model that achieves performance comparable to G…

it doesn’t look like the curl command includes tool calls, so that might be why? in the persona settings, are there any tools listed here? [image]

@awesomerobot We haven’t included any custom Personas yet, so all the ones you see in the app are just the default options. Also, we’re not using any of them at the moment! Personas: [image] Tools [image]

After taking another look at your earlier screenshot, I see that you’re using the forum helper persona in your message… that persona includes some built-in tools that you can’t remove and will not work with the model you’re using. You should try one of the pre-configured personas that doesn’t inclu…

Could you please clarify if having a persona is essential for the effective functioning of LLMs?

Yes, our AI features use an LLM with a specified persona. When you have more than one persona enabled and create a new message, you’ll see a dropdown menu that lets you choose the persona: [image] For testing purposes, if you enable the built-in Creative persona: [image] and then refresh the …

I am seeing only these option, could you please help me with the setting [image]

You need to visit /admin/plugins/discourse-ai/ai-personas and either create a new persona or enable one without tools. If you want to try an existing persona, Creative would be a good one to test as it doesn’t include any tools. So you’d click edit here: [image] and at the bottom of the persona …

自定义 LLM - 作业异常 [deepseek-coder-v2:latest 不支持工具\",\"type\":\"api_error\",\"param\":null,\"code\":null]

支持

Roman (Roman Rizzi) 2025年九月5日 17:59 16

如果模型没有原生工具支持，您始终可以使用 XML 替代方案，它会将工具包含在提示中：

話題		回覆	觀看
Support for o1-preview & o1-mini Feature completed , ai	10	1660	2024年九月16日
Support for AI Bot to Configure for a Support the community forum with latest version of Discourse Support ai	19	676	2025年十二月4日
Error using Claude 3.7 Sonnet with Discourse AI plugin Bug ai , ai-bot	10	1630	2025年三月5日
Internal Server Error 500- Manual configuration [ Discourse AI] Support ai	7	425	2025年九月5日
AI Chat errors Support ai	4	256	2026年二月19日

自定义 LLM - 作业异常 [deepseek-coder-v2:latest 不支持工具\",\"type\":\"api_error\",\"param\":null,\"code\":null]

相關主題