Аргументы в пользу жесткого лимита использования ИИ для групп пользователей в ИИ-ботах и ИИ-помощнике

sam · 13.Январь.2025 02:50:56

Ожидается, что это будет выпущено на этой неделе:

github.com/discourse/discourse-ai

FEATURE: llm quotas (#1047)

main ← quotas2

merged 04:54AM - 14 Jan 25 UTC

SamSaffron

+1684 -152

Adds a comprehensive quota management system for LLM models that allows: - Se…tting per-group token and usage limits with configurable durations - Tracking and enforcing token/usage limits across user groups - Quota reset periods (hourly, daily, weekly, or custom) - Admin UI for managing quotas with real-time updates - Full test coverage for quota models and controllers This system provides granular control over LLM API usage by allowing admins to define limits on both total tokens and number of requests per group. Supports multiple concurrent quotas per model and automatically handles quota resets. ![image](https://github.com/user-attachments/assets/76375c76-889d-438b-b464-e65c7f7a41ed) ![image](https://github.com/user-attachments/assets/21752366-2b33-4fb7-8b3f-faee74c45413) ![image](https://github.com/user-attachments/assets/c7248930-0aa7-434e-805e-56adb7cbfb2f)

Тема		Ответов	Просм.
Limit the number of AI tokens a user can use in a day? Feature completed , ai	11	1374	03.04.2025
Balancing Costs and Functionality in AI-Powered Forums Feature ai , ai-bot	4	954	21.01.2025
Configuring LLM Usage Quotas in Discourse AI Site Management official , how-to , ai	4	833	21.01.2025
LLM Quotas for Discourse AI Announcements ai	0	244	21.01.2025
Cost based quotas for Discourse AI Announcements ai	0	212	30.06.2026

Аргументы в пользу жесткого лимита использования ИИ для групп пользователей в ИИ-ботах и ИИ-помощнике

Связанные темы