AI is being cutoff before it finishes writing

Unfortunately setting it to provider OpenAI makes it fail (can’t ‘run test’), so provider google definitely makes it go through. I’ll remove cloudflare’s AI gateway to test ‘raw’ but what surprises me is that the data anyway is still being received completely by discourse tho , otherwise that response data I posted couldn’t be visible. I’m getting that when clicking in the “info” button and doing copy response

Edit:

Switching from cloudflare’s ai gateway to the api directly seems to have good results. I will keep monitoring and testing

2 Likes