Discourse AI を有効化した場合の関連コンテンツと検索にかかる費用の見積もり

[NateDhaliwal]

@SubStrider

For self hosted LLM, what is a typical server config/cost that would be required?

I believe you would need a GPU it is better with a GPU if you want to self-host. Check out things like Ollama.

Also see:

Estimating costs of using LLMs for Discourse AI

In order to use certain Discourse AI features, users are required to use a Large Language Model (LLM) provider. Please see each AI feature to determine which LLMs are compatible. If cost is a significant worry, one way to combat that is to set usage limits right from the vendor and use a monthly budget. Another option is to only let select users and groups access the AI features There are several variable factors to consider when calculating the costs of using…