Can't stop ai bot streaming

Hello :wave:

The gpt4o mini seems to have gone crazy and it can’t stop streaming for over 1 hour now. Every time I click the pause button it nothing happens just stop a sec. The temperature has been set too high. Is there any way to stop it? It writes random things all the time. :sweat_smile:

Thanks :slight_smile:

1 Like

oh my… what … where?

In personal message.

I do have a repro on the pause issue… having a look… this is certainly a bug. cancel is not canceling.

2 Likes

If I rebuild it will stop or continue after it?

it will stop if you restart the container

1 Like

Thanks Sam, it worked! Luckily, it was only the gpt4o mini :sweat_smile:

I don’t think they can charge you beyond the limit of what they generate, cause it is a bug on their side.

But yeah I regressed this while refactoring, will merge shortly and add a test here.

3 Likes

I see now, thanks for the fix! :slightly_smiling_face:

just merged it, there is a test as well, be sure to play with artifacts :slight_smile:

2 Likes

Yes they can. Been there.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.