Limitieren Sie die Anzahl der KI-Tokens, die ein Benutzer an einem Tag verwenden kann?

sam · 13. Januar 2025 um 02:50

Technisch gesehen sind sie gleich, Sie erstellen einfach eine Gruppe von 1.

Dies sollte diese Woche eintreffen und das Problem lösen:

github.com/discourse/discourse-ai

FEATURE: llm quotas

main ← quotas2

opened 06:20AM - 02 Jan 25 UTC

SamSaffron

+1684 -152

Adds a comprehensive quota management system for LLM models that allows: - Se…tting per-group token and usage limits with configurable durations - Tracking and enforcing token/usage limits across user groups - Quota reset periods (hourly, daily, weekly, or custom) - Admin UI for managing quotas with real-time updates - Full test coverage for quota models and controllers This system provides granular control over LLM API usage by allowing admins to define limits on both total tokens and number of requests per group. Supports multiple concurrent quotas per model and automatically handles quota resets. ![image](https://github.com/user-attachments/assets/76375c76-889d-438b-b464-e65c7f7a41ed) ![image](https://github.com/user-attachments/assets/21752366-2b33-4fb7-8b3f-faee74c45413) ![image](https://github.com/user-attachments/assets/c7248930-0aa7-434e-805e-56adb7cbfb2f)

Thema		Antworten	Aufrufe
Making the case for a hard cap feature on user group AI usage for AI bots and AI Helper Feature chat , completed , ai , ai-bot	12	196	26. Januar 2025
Configuring LLM Usage Quotas in Discourse AI Site Management official , how-to , ai	4	341	21. Januar 2025
Balancing Costs and Functionality in AI-Powered Forums Feature ai , ai-bot	4	695	21. Januar 2025
LLM Quotas for Discourse AI Announcements ai	0	139	21. Januar 2025
Limit # topic posts / user / month Feature	21	1221	18. Dezember 2023

Limitieren Sie die Anzahl der KI-Tokens, die ein Benutzer an einem Tag verwenden kann?

Verwandte Themen