If you mean using a Local LLM, I do not have plans to increase expenses yet. On the server, it requires a lot of processing power for more than 20 concurrent users, so this plan is not being implemented. I would like to focus on using external APIs such as Groq or OpenRouter, which are more cost-effective, and try to control costs in this area.
Thefacto
(Thefacto)
6
Gerelateerde topics
| Topic | Antwoorden | Weergaven | Activiteit | |
|---|---|---|---|---|
| Estimating cost of enabling Discourse AI for related content and search | 2 | 332 | 28 oktober 2025 | |
| How to configure Discourse to use a locally installed LLM? | 7 | 576 | 3 juni 2025 | |
| What LLM to use for Discourse AI? | 0 | 1138 | 23 januari 2025 | |
| Configuring Discourse AI with internal OpenAI APIs | 14 | 493 | 19 augustus 2026 | |
| Unlock All Discourse AI Features with Our Hosted LLM | 9 | 1521 | 13 maart 2026 |