Don
21 نوفمبر 2024، 5:31ص
1
Hello
The gpt4o mini seems to have gone crazy and it can’t stop streaming for over 1 hour now. Every time I click the pause button it nothing happens just stop a sec. The temperature has been set too high. Is there any way to stop it? It writes random things all the time.
Thanks
إعجاب واحد (1)
sam
(Sam Saffron)
21 نوفمبر 2024، 5:37ص
4
I do have a repro on the pause issue… having a look… this is certainly a bug. cancel is not canceling.
إعجابَين (2)
Don
21 نوفمبر 2024، 5:37ص
5
If I rebuild it will stop or continue after it?
sam
(Sam Saffron)
21 نوفمبر 2024، 5:38ص
6
it will stop if you restart the container
إعجاب واحد (1)
Don
21 نوفمبر 2024، 5:52ص
7
Thanks Sam, it worked! Luckily, it was only the gpt4o mini
sam
(Sam Saffron)
21 نوفمبر 2024، 5:56ص
8
discourse:main
← discourse:fix-stream-stop
opened 05:55AM - 21 Nov 24 UTC
The cancel messaging was not floating correctly to the HTTP call
I don’t think they can charge you beyond the limit of what they generate, cause it is a bug on their side.
But yeah I regressed this while refactoring, will merge shortly and add a test here.
3 إعجابات
Don
21 نوفمبر 2024، 6:03ص
9
I see now, thanks for the fix!
sam
(Sam Saffron)
21 نوفمبر 2024، 6:52ص
10
just merged it, there is a test as well, be sure to play with artifacts
إعجابَين (2)
Jagster
(Jakke Lehtonen)
21 نوفمبر 2024، 7:18ص
11
Yes they can. Been there.
إعجاب واحد (1)
j.jaffeux
(Joffrey Jaffeux)
تم إغلاقه في
24 نوفمبر 2024، 7:18ص
12
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.