Self-Hosting an OpenSource LLM for DiscourseAI

Thanks ! I noticed as well that the URL only works when the AI plugin is enabled :person_facepalming:

For the newly added provider, any suggestions what to choose/set for the following required settings ?

  1. Tokenizer
  2. Context window

For the model, I was thinking to maybe use stablelm2:1.6b or translategemma:4b but dunno yet.
In the README of the latter there is some description of an input prompt. I wonder what the query is that the translation AI feature sends to Ollama. c.f. /admin/plugins/discourse-ai/ai-agents/-28/edit