I’m trying to get one running on the localhost to test so put the URL as: “http://172.17.0.1:8081/v1/chat/completions” and get internal server error. I’m able to curl “http://172.17.0.1:8081/v1/models” from the discourse docker container so the connectivity is working.
Are there any other gotchas (e.g. does Discourse allow non-https and arbitrary ports for the LLM endpoint)?