# Does Discourse AI support third-party relay/proxy APIs (e.g., NewAPI)? Getting “Internal Server Error”

**URL:** https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980
**Category:** Support
**Tags:** ai
**Created:** [30 november 2025 om 17:08 UTC](https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980 "2025-11-30T17:08:53Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![tom\_eric](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/tom_eric/32/527845_2.png) [@tom\_eric](https://meta.discourse.org/u/tom_eric)
#### Post date: [30 november 2025 om 17:08 UTC](https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980/1 "2025-11-30T17:08:53Z")

</div>

Hi everyone,  
I have a question about Discourse AI and whether it supports third-party relay/proxy APIs.

I tried using a relay API from **NewAPI** (a third-party OpenAI-compatible proxy), but Discourse AI returns an **“Internal Server Error.”** I’m not sure if this is a configuration issue on my side or a limitation of Discourse AI.

So I’m wondering:

1. **Does Discourse AI currently support OpenAI-compatible third-party / relay / proxy APIs?**

2. Or does it only support **official OpenAI and Google APIs** right now?

3. If third-party APIs are supported, is there any special setup required (headers, base URL format, model naming, etc.)?

Using my own official API keys gets expensive, so I’m hoping to use a cheaper relay option if possible.  
Also, I’d like to connect **Google BananaPro** for image generation just for fun — not sure if that’s supported either.

Any pointers or docs would be appreciated. Thanks!

---

<div class="post-metadata">

### Author: ![Falco](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/falco/32/179432_2.png) [@Falco](https://meta.discourse.org/u/Falco)
#### Post date: [30 november 2025 om 17:15 UTC](https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980/2 "2025-11-30T17:15:13Z")

</div>

We have customers doing thousands of AI calls daily through OpenAI compatible proxies, so we know it works. The main issue is when they say “OpenAI compatible” is how compatible they really are.

vLLM, Google, Ollama, LMStudio all provide OpenAI compatible APIs that we test and use daily.

Of a specific provider is failing, it’s usually easy to find why via the logs in the /logs page. Can you share the error from there?

---

<div class="post-metadata">

### Author: ![tom\_eric](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/tom_eric/32/527845_2.png) [@tom\_eric](https://meta.discourse.org/u/tom_eric)
#### Post date: [30 november 2025 om 17:41 UTC](https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980/3 "2025-11-30T17:41:42Z")

</div>

Thank you for your reply. I will test a few different third-party APIs tomorrow

---

<div class="post-metadata">

### Author: ![whitewaterdeu](https://avatars.discourse-cdn.com/v4/letter/w/57b2e6/32.png) [@whitewaterdeu](https://meta.discourse.org/u/whitewaterdeu)
#### Post date: [30 november 2025 om 18:32 UTC](https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980/4 "2025-11-30T18:32:25Z")

</div>

discourse ai support almost any third-party APIs i know, such as openrouter，newapi

just config llm settings

 ![image](https://global.discourse-cdn.com/meta/original/4X/3/a/0/3a0266a66945f16c9afa4a4284ec8fbc53fa2e12.png)

enter your api base url, api key and model name

 ![image](https://global.discourse-cdn.com/meta/original/4X/2/3/3/2336b86591798d7297dadc4b9832bffb557d1bc4.png)

---

<div class="post-metadata">

### Author: ![tom\_eric](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/tom_eric/32/527845_2.png) [@tom\_eric](https://meta.discourse.org/u/tom_eric)
#### Post date: [30 november 2025 om 18:42 UTC](https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980/5 "2025-11-30T18:42:39Z")

</div>

Thanks for the reply, brother.

![image](https://sea3.discourse-cdn.com/meta/images/transparent.png)

But this reply is very strange.

Discourse requires filling in the system prompt. I don’t want to fill in the system prompt, I only entered one.

It should be a direct answer to the user’s @ question, the model should just answer directly.

I haven’t figured out how to configure it yet.

When @-ing the bot, for some reason, the default prompt is the “Custom Prompt” prompt (because the format of its reply matches only this “Custom Prompt” prompt, as shown in the figure below). Changing it still has no effect, I don’t know why.

![image](https://sea3.discourse-cdn.com/meta/images/transparent.png)

---

<div class="post-metadata">

### Author: ![whitewaterdeu](https://avatars.discourse-cdn.com/v4/letter/w/57b2e6/32.png) [@whitewaterdeu](https://meta.discourse.org/u/whitewaterdeu)
#### Post date: [1 december 2025 om 06:30 UTC](https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980/6 "2025-12-01T06:30:12Z")

</div>

you can create a new persona before setting `AI helper custom prompt persona`

 ![image](https://global.discourse-cdn.com/meta/original/4X/8/9/3/8933acf2d76753107c4342dd985f4efe5183210e.png)

this is an example of my new translator persona(you can config prompt and other options)

 ![image](https://global.discourse-cdn.com/meta/original/4X/7/c/4/7c414b6b99444e21b6bcbcebaf4f91b3fd447e36.png)

then choose your new custom persona in `AI helper custom prompt persona`

 ![image](https://global.discourse-cdn.com/meta/original/4X/d/a/d/dad6c896a6eaccdeaf4ffa82f77d168b5752c06c.png)

---

<div class="post-metadata">

### Author: ![system](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/system/32/443519_2.png) [@system](https://meta.discourse.org/u/system)
#### Post date: [31 december 2025 om 06:30 UTC](https://meta.discourse.org/t/does-discourse-ai-support-third-party-relay-proxy-apis-e-g-newapi-getting-internal-server-error/389980/7 "2025-12-31T06:30:56Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
