I was able to get this to work by doing DISCOURSE_ALLOWED_INTERNAL_HOSTS: localhost as an environment variable to connect to my LiteLLM sidecar hosted at localhost:4000. I also have a pull request to add vertex AI auth here: DEV: add Google Vertex AI LLM provider by evantobin · Pull Request #41350 · discourse/discourse · GitHub
evantobin
(evan)
8
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Self-Hosting an OpenSource LLM for DiscourseAI | 12 | 3893 | July 6, 2026 | |
| Debugging adding new LLM | 8 | 483 | August 23, 2024 | |
| Create custom LLM plugin or any other option? | 4 | 198 | February 25, 2025 | |
| Discourse AI with local ollama Internal Server Error | 1 | 142 | December 27, 2025 | |
| Internal Server Error 500- Manual configuration [ Discourse AI] | 7 | 293 | September 5, 2025 |