I was able to get this to work by doing DISCOURSE_ALLOWED_INTERNAL_HOSTS: localhost as an environment variable to connect to my LiteLLM sidecar hosted at localhost:4000. I also have a pull request to add vertex AI auth here: FEATURE: add Google Vertex AI LLM provider - Pull Request #41350 - discourse/discourse - GitHub
evantobin
(evan)
8
Gerelateerde topics
| Topic | Antwoorden | Weergaven | Activiteit | |
|---|---|---|---|---|
| Self-Hosting an OpenSource LLM for DiscourseAI | 12 | 3992 | 6 juli 2026 | |
| Debugging adding new LLM | 8 | 501 | 23 augustus 2024 | |
| Create custom LLM plugin or any other option? | 4 | 201 | 25 februari 2025 | |
| Discourse AI with local ollama Internal Server Error | 1 | 156 | 27 december 2025 | |
| Internal Server Error 500- Manual configuration [ Discourse AI] | 7 | 314 | 5 september 2025 |