How to configure Discourse to use a locally installed LLM?

I think as long as it exposes a supported API it should be possible.

Is there a particular LLM you are planning to (or already have) installed locally?

4 Likes