Can't stop ai bot streaming

Bug
, ,
1

Hello :wave:

The gpt4o mini seems to have gone crazy and it can’t stop streaming for over 1 hour now. Every time I click the pause button it nothing happens just stop a sec. The temperature has been set too high. Is there any way to stop it? It writes random things all the time. :sweat_smile:

Thanks :slight_smile:

1 Like
2

oh my… what … where?

3

In personal message.

4

I do have a repro on the pause issue… having a look… this is certainly a bug. cancel is not canceling.

2 Likes
5

If I rebuild it will stop or continue after it?

6

it will stop if you restart the container

1 Like
7

Thanks Sam, it worked! Luckily, it was only the gpt4o mini :sweat_smile:

8

I don’t think they can charge you beyond the limit of what they generate, cause it is a bug on their side.

But yeah I regressed this while refactoring, will merge shortly and add a test here.

3 Likes
9

I see now, thanks for the fix! :slightly_smiling_face:

10

just merged it, there is a test as well, be sure to play with artifacts :slight_smile:

2 Likes
11

Yes they can. Been there.

1 Like