Is there perhaps any plan to implement group-based limits? For example “Group A” can send 100 messages or 10,000 tokens to AI Bot per day?
3 Likes
Agree, we would very much like to build a system for quotas
2 Likes
I just discovered one issue. My bot wasn’t writing back to me so I checked the logs and I saw that the temperature was out of range.
OpenAI models have a temperature range 1 - 2 whereas Anthropic models have a range of 0 - 1. So, if you set a temperature of, for example, 1.2 in your persona, then you can not use an Anthropic model in your LLM dropdown list when you go to chat with the bot (and vice-versa with OpenAI).
This could prove to be a limitation because it forces users to either:
- Use ONLY the default values if there are models from companies with different ranges
- Use ONLY models from one company so that you can actually set the temperature.
I wanted to provide a selection of models to my users, however currently I can’t let them choose between OpenAI or Anthropic models because I need to set a temperature 
1 Like
Coming back to this, and just throwing an idea up into the air…
Stripe subscriptions with metered usage looks like it might play well with this idea… Quite similar to how Mailgun operates: ‘x’ amount of tokens allowed per month. Additional ‘y’ amount of tokens used incurs an additional ‘z’ - or simply block the user’s AI access after ‘x’ is used up. The user would be able monitor their token usage via their profile of course