I'd like to know which LLMs everyone is using with the Discourse AI plugin

I found that the custom DeepSeek v4.1 flash model on the official DeepSeek website is not working, and there are issues with the Qwen large model’s AI search.

I’d like to know what everyone else is using. Are all the Discourse AI features available?

Thanks

It is? And it’s working pretty well too.

What does “not working” mean?

1 Like

Successfully configured DeepSeek in the admin panel:

  1. Unable to use AI to summarize topics
{
  "error": {
    "message": "This response_format type is unavailable now",
    "type": "invalid_request_error",
    "param": null,
    "code": "invalid_request_error"
  }
}
  1. Ask AI cannot complete this search.

1 Like

I can confirm that Deepseek and also GLM models needs some custom hooks for Discourse AI pairing.

I did it through LiteLLM as a proxy for the final endpoints but a core implementation would be appreciated.

Gemini 2.5 Flash Lite.

Previously I had briefly upgraded to use the newer 3.1 Flash Lite. But the quality remained about the same while price went up, so I switched back to the cheaper 2.5FL.

3.1FL cost me only about €0,10/ day for my setup. 2.5FL took that further down to €0,01/day.

1 Like