Help understanding OpenRouter language models

[pfaffman (Jay Pfaffman)]

I was going to reply but think that I’m not supposed to be able to reply there? (Or maybe it was something else that I once replied to taht wasn’t supposed to and perhaps I no longer have special powers).

Continuing the discussion from Configuring OpenRouter language models:

@sam

Some models on open router do not support native tools, in those cases you should disable native tools so you can still get XML based tools. Additionally performance varies so you should test if XML or native tools give you better results for a model.

Sorry. I still don’t understand, and I know a lot more about at least Discourse than at least most people this is for (but likely know less about AI?). This is the first mention of “XML tools in this topic…”

The OpenRouter tools are XML tools? Normal People don’t care that XML is referring to some underlying details of how the API works, but I’m curious.

And “Native tools” refers to configuring API keys for Anthropic and OpenAI? On the /admin/plugins/discourse-ai/ai-llms page? And these XML tools, like the Native Tools both allow you to create personas that use some of these LLMs, right?

[sam (Sam Saffron)]

Open Router has some models with native tool support and some models that lack native tool support. It is documented on each model.

Attempting to make native tool calls to these unsupported models will crash the call.

Luckily, Discourse implements its own tool system, so you end up having access to features that a model provider does not natively implement.

[Falco]

Also worth mentioning the tools only affect Discourse AI Bot currently. For AI Helper, Summarize, Search, Automation we don’t use tools, so you can pick a model with or without support and it won’t matter there.