Debugging adding new LLM

[Lilly (Lillian Louis)]

There’s a topic here about it

Can I add other LLM?

It works with VLLM, you can can just configure a VLLM endpoint and it should work out of the box.