I was able to get this to work by doing DISCOURSE_ALLOWED_INTERNAL_HOSTS: localhost as an environment variable to connect to my LiteLLM sidecar hosted at localhost:4000. I also have a pull request to add vertex AI auth here: FEATURE: add Google Vertex AI LLM provider - Pull Request #41350 - discourse/discourse - GitHub
evantobin
(evan)
8
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Configuring Discourse AI with internal OpenAI APIs | 14 | 200 | August 19, 2026 | |
| Self-Hosting an OpenSource LLM for DiscourseAI | 12 | 4102 | July 6, 2026 | |
| Debugging adding new LLM | 8 | 517 | August 23, 2024 | |
| Create custom LLM plugin or any other option? | 4 | 224 | February 25, 2025 | |
| Discourse AI with local ollama Internal Server Error | 1 | 179 | December 27, 2025 |