How to set up Discourse AI for internal-only usage

Product Support
5

Thank you for the advice on language usage.

Summary of the problem I am facing (explained simply):

  • I am using Discourse AI on a self-hosted website.
  • The LLM I am using is MiMo API by Xiaomi, which provides a quota of 1000 requests per month.
  • The issue is that using certain extensions (like web search) incurs additional charges based on usage and cannot be disabled from the provider’s side.

The provider explained that:

  • Costs depend on the length and nature of the prompt.
  • For example, if I or a user types something like “Search for the latest news about…”, regardless of whether the information is already in my forum, the model might automatically search the web as well.

This makes it:

  • Difficult for me to control costs because the user types the prompt themselves.

I did not enter a Google Custom Search Engine API key, leaving this field blank and using the default setting for Forum Helper.

If I try to limit the credit from the provider’s side:

  • It will limit all models currently in use.
  • It cannot limit specific models or specific features.

Here is an example of the log I can check:

Generation details
Model: MiMo-V2-Flash
Model ID: xiaomi/mimo-v2-flash
Provider: Xiaomi

First token latency: 12.77 seconds
Throughput: 1.5 tokens/second
Finish reason: stop
Data policy: No data training | Policy

Tokens:
- Prompt: 38065
- Completion: 20

Web search:
- Results: 5

Costs:
- Subtotal: 0
- Web search cost: 0.02
- Final cost: 0.02

Creator: hidden 
Generation ID: hidden