main ← quotas2
opened 06:20AM - 02 Jan 25 UTC
Adds a comprehensive quota management system for LLM models that allows:
- Se…tting per-group token and usage limits with configurable durations
- Tracking and enforcing token/usage limits across user groups
- Quota reset periods (hourly, daily, weekly, or custom)
- Admin UI for managing quotas with real-time updates
- Full test coverage for quota models and controllers
This system provides granular control over LLM API usage by allowing admins
to define limits on both total tokens and number of requests per group.
Supports multiple concurrent quotas per model and automatically handles
quota resets.
