When I set Max Context Posts
to a number, when this number of posts is reached in a PM conversation the bot simply stops replying.
Is this the intent of that setting? If yes shouldn’t it alert the user that a threshold was reached instead of simply stop replying?
It doesn’t work that way. It ”remembers” that many answers and use that as keeping context and using it as base of new answers.
Propably use are using too many tokens or something similar and it just stops fullfilling your request.
I guess error log should show something.
Yes, that’s also what I thought from the description.
But until yesterday it would just hang if I reach the number of posts.
Today when I tried it it works as expected - doesn’t hang and just keeps the specified number of posts. So this seems to be fixed 
Odd issue, but yeah it just sets the size of the context.
I wonder if there is some bug lurking here during upgrades.
I also do want to add a “summarize” strategy, which will allow enormous contexts with small token counts. (for every N tokens, summarize the tokens for important key information)
This topic was automatically closed after 46 hours. New replies are no longer allowed.