I wonder what the right approach is for using internal AI API endpoints (like LiteLLM) on self-hosted Discourse instances. I tried enabling docker bridge, container IPs, and proper SSL-terminated endpoints (to the same public IP where Discourse is hosted), but nothing works. I allowed internal host…

I solved it adding the Docker Internal Gateway IP to DISCOURSE_ALLOWED_INTERNAL_HOSTS and exposing the port on LiteLLM docker-compose.yml file: ports: - "4444:4000" Nginx points to LITELLM_IP:4000 and Discourse to GATEWAY_IP:4444 to avoid port conflicts. Then I solved the errors on M…

If you are running it on the same server, you will need to allow it via DISCOURSE_ALLOWED_INTERNAL_HOSTS env variable.

I did it on UI like I saw on a previous similar post . Tried also with the variable on my app.yml file but still getting the error. What can be wrong if my credentials are OK and I can use the API endpoint on the host? Can I debug more?

How exactly did you add it to the app.yml ? It expects either an IP or a hostname.

Well, I tested the endpoint with SSL within Discourse (app container) and it works, but not from the Discourse AI UI test. I’m using ‘OpenAI’ Provider with ‘ https://llm.mydomain.tld/v1/chat/completions ’ as URL. The credentials are OK: /var/www/discourse/plugins/discourse-ai/lib/completions/endpoin…

[image] satonotdead: I’m using ‘OpenAI’ Provider with ‘ https://llm.mydomain.tld/v1/chat/completions’ as URL. The credentials are OK: [image] satonotdead: DISCOURSE_ALLOWED_INTERNAL_HOSTS: 172.16.X.X Try DISCOURSE_ALLOWED_INTERNAL_HOSTS: llm.mydomain.tld instead then.

Already did it as I wrote before, nothing is working and I’m kindly asking how to debug more because it’s something strange. This endpoint works within the Discourse container app but not from Discourse UI as is.

I was able to get this to work by doing DISCOURSE_ALLOWED_INTERNAL_HOSTS: localhost as an environment variable to connect to my LiteLLM sidecar hosted at localhost:4000. I also have a pull request to add vertex AI auth here: FEATURE: add Google Vertex AI LLM provider - Pull Request #41350 - discours…

Comment utiliser les points de terminaison IA internes ?

Soutien

Falco (Falco) Juin 22, 2026, 8:45 4

Comment avez-vous exactement ajouté cela au fichier app.yml ? Il attend soit une adresse IP, soit un nom d’hôte.

Sujet		Réponses	Vues
Self-Hosting an OpenSource LLM for DiscourseAI Self-Hosting ai	12	3992	Juillet 6, 2026
Debugging adding new LLM Support ai	8	501	Août 23, 2024
Create custom LLM plugin or any other option? Support	4	201	Février 25, 2025
Discourse AI with local ollama Internal Server Error Bug ai	1	156	Décembre 27, 2025
Internal Server Error 500- Manual configuration [ Discourse AI] Support ai	7	314	Septembre 5, 2025

Comment utiliser les points de terminaison IA internes ?

Sujets connexes