Don
2024 年 11 月 21 日午前 5:31
1
Hello
The gpt4o mini seems to have gone crazy and it can’t stop streaming for over 1 hour now. Every time I click the pause button it nothing happens just stop a sec. The temperature has been set too high. Is there any way to stop it? It writes random things all the time.
Thanks
「いいね!」 1
sam
(Sam Saffron)
2024 年 11 月 21 日午前 5:37
4
I do have a repro on the pause issue… having a look… this is certainly a bug. cancel is not canceling.
「いいね!」 2
Don
2024 年 11 月 21 日午前 5:37
5
If I rebuild it will stop or continue after it?
sam
(Sam Saffron)
2024 年 11 月 21 日午前 5:38
6
it will stop if you restart the container
「いいね!」 1
Don
2024 年 11 月 21 日午前 5:52
7
Thanks Sam, it worked! Luckily, it was only the gpt4o mini
sam
(Sam Saffron)
2024 年 11 月 21 日午前 5:56
8
discourse:main
← discourse:fix-stream-stop
opened 05:55AM - 21 Nov 24 UTC
The cancel messaging was not floating correctly to the HTTP call
I don’t think they can charge you beyond the limit of what they generate, cause it is a bug on their side.
But yeah I regressed this while refactoring, will merge shortly and add a test here.
「いいね!」 3
Don
2024 年 11 月 21 日午前 6:03
9
I see now, thanks for the fix!
sam
(Sam Saffron)
2024 年 11 月 21 日午前 6:52
10
just merged it, there is a test as well, be sure to play with artifacts
「いいね!」 2
Jagster
(Jakke Lehtonen)
2024 年 11 月 21 日午前 7:18
11
Yes they can. Been there.
「いいね!」 1
j.jaffeux
(Joffrey Jaffeux)
クローズされました:
2024 年 11 月 24 日午前 7:18
12
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.