Can I add other LLM?

It works with VLLM, you can can just configure a VLLM endpoint and it should work out of the box.

5 Likes