Discourse Translator

[NateDhaliwal]

See this guide:

Self-Hosting an OpenSource LLM for DiscourseAI

The Discourse AI plugin has many features that require an LLM to be enabled, like, for example, Summarization, AI Helper, AI Search, AI Bot. While you can use a third party API, like Configure API Keys for OpenAI or Configure API Keys for Anthropic we built Discourse AI since first day to not be locked into those. Running with HuggingFace TGI HuggingFace provides an awesome container image that can get you running quickly. For example: mkdir -p /opt/tgi-cache docker run --rm --gpus all --shm…

@happyhappy

Also, many of our users do not want to use AI translation for privacy reasons.

Then… why do you want to host LLMs?

For others, see Using Discourse and LibreTranslate without AI which is related.