Cost based quotas for Discourse AI

[sam (Sam Saffron)]

Managing AI costs is very challenging for many companies.

For a long time, Discourse has had the ability to manage AI usage by defining a maximum number of tokens or spend per group.

Today, we added the ability to control spend by estimated dollar cost!

This means that you can budget $5 for AI usage for a particular group, and regardless of provider, we will try to keep to that budget.

Learn more at:

Configuring LLM Usage Quotas in Discourse AI

This guide explains how to configure and manage usage quotas for Large Language Models (LLMs) in Discourse AI. Required user level: Administrator Summary LLM Usage Quotas allow administrators to control and monitor AI resource consumption by setting limits on token usage and interactions for different user groups. This helps maintain cost efficiency while ensuring fair access to AI features across your community. Configuration Accessing quota settings Navig…