The discussion revolves around the “Max Context Posts” setting in an AI bot. Initially, tpetrov thought that reaching this number would cause the bot to stop replying, but Jagster clarified that it actually sets the context size for the bot’s answers. After an update, tpetrov found that the bot now works as expected, no longer hanging when the post limit is reached. sam suspects a possible bug during upgrades and proposes adding a “summarize” strategy to handle large contexts with small token counts.
It doesn’t work that way. It ”remembers” that many answers and use that as keeping context and using it as base of new answers.
Propably use are using too many tokens or something similar and it just stops fullfilling your request.
I guess error log should show something.
Yes, that’s also what I thought from the description.
But until yesterday it would just hang if I reach the number of posts.
Today when I tried it it works as expected - doesn’t hang and just keeps the specified number of posts. So this seems to be fixed 
Odd issue, but yeah it just sets the size of the context.
I wonder if there is some bug lurking here during upgrades.
I also do want to add a “summarize” strategy, which will allow enormous contexts with small token counts. (for every N tokens, summarize the tokens for important key information)
