估算启用 Discourse AI 以支持相关内容和搜索的成本

[NateDhaliwal]

@SubStrider

对于自托管的 LLM，需要什么样的典型服务器配置/成本？

我认为你需要一块 GPU 如果你想自托管的话，有 GPU 会更好。可以看看 Ollama 之类的。

另请参阅：

Estimating costs of using LLMs for Discourse AI

In order to use certain Discourse AI features, users are required to use a Large Language Model (LLM) provider. Please see each AI feature to determine which LLMs are compatible. If cost is a significant worry, one way to combat that is to set usage limits right from the vendor and use a monthly budget. Another option is to only let select users and groups access the AI features There are several variable factors to consider when calculating the costs of using…