AIボット・AI HelperのユーザーグループAI利用にハードキャップ機能を導入すべきか

sam · 2025 年 1 月 13 日午前 2:50

This is expected to land this week:

github.com/discourse/discourse-ai

FEATURE: llm quotas

discourse:main ← discourse:quotas2

opened 06:20AM - 02 Jan 25 UTC

SamSaffron

+1508 -5

Adds a comprehensive quota management system for LLM models that allows: - Se…tting per-group token and usage limits with configurable durations - Tracking and enforcing token/usage limits across user groups - Quota reset periods (hourly, daily, weekly, or custom) - Admin UI for managing quotas with real-time updates - Full test coverage for quota models and controllers This system provides granular control over LLM API usage by allowing admins to define limits on both total tokens and number of requests per group. Supports multiple concurrent quotas per model and automatically handles quota resets. ![image](https://github.com/user-attachments/assets/76375c76-889d-438b-b464-e65c7f7a41ed) ![image](https://github.com/user-attachments/assets/21752366-2b33-4fb7-8b3f-faee74c45413) ![image](https://github.com/user-attachments/assets/c7248930-0aa7-434e-805e-56adb7cbfb2f)

トピック		返信	表示
Limit the number of AI tokens a user can use in a day? Feature completed , ai	12	380	2025 年 4 月 3 日
Balancing Costs and Functionality in AI-Powered Forums Feature ai , ai-bot	4	686	2025 年 1 月 21 日
Configuring LLM Usage Quotas in Discourse AI Site Management official , how-to , ai	4	263	2025 年 1 月 21 日
LLM Quotas for Discourse AI Announcements ai	0	134	2025 年 1 月 21 日
Discourse AI - AI usage Site Management how-to , ai	0	312	2025 年 1 月 23 日

AIボット・AI HelperのユーザーグループAI利用にハードキャップ機能を導入すべきか

関連トピック