The discussion “Can’t stop ai bot streaming” revolves around an issue with the gpt4o mini bot. Don reports that the bot has been streaming non-stop for over an hour, despite attempts to pause it, and is writing random things. Sam acknowledges the issue as a bug, specifically with the pause function not cancelling properly. Sam advises Don to restart the container, which resolves the issue. Sam also provides a link to a pull request on GitHub to fix the bug, mentioning that the issue should not incur additional charges. However, Jagster disputes this, stating that it is possible to be charged beyond the limit due to such bugs.
Hello 
The gpt4o mini seems to have gone crazy and it can’t stop streaming for over 1 hour now. Every time I click the pause button it nothing happens just stop a sec. The temperature has been set too high. Is there any way to stop it? It writes random things all the time. 
Thanks 
oh my… what … where?
In personal message.
I do have a repro on the pause issue… having a look… this is certainly a bug. cancel is not canceling.
If I rebuild it will stop or continue after it?
it will stop if you restart the container
Thanks Sam, it worked! Luckily, it was only the gpt4o mini
https://github.com/discourse/discourse-ai/pull/938
I don’t think they can charge you beyond the limit of what they generate, cause it is a bug on their side.
But yeah I regressed this while refactoring, will merge shortly and add a test here.
I see now, thanks for the fix! 
just merged it, there is a test as well, be sure to play with artifacts
Yes they can. Been there.
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.