Cost of CDCK Hosted models

AI-generated summary

In the discussion titled ‘Cost of CDCK Hosted models’ under the Support category with the AI tag, users inquire about pricing and usage limits for CDCK-hosted LLMs and embeddings. xeraa asks whether these models are free and if there are usage limits beyond fair use, noting the lack of clarity on the pricing page and in prior threads. Falco clarifies that CDCK-hosted LLMs are currently available experimentally at no extra cost and with no usage limit beyond fair use, accessible via a toggle under the ‘What’s New’ feed. Embeddings models, available for over a year, are not experimental and are included in the hosting service, now visible under the new ‘Embeddings’ tab in AI configuration. xeraa follows up, asking if users will be notified of any future changes and associated costs; Falco confirms that any changes would involve ending the current experiments and launching a new offer. Joe_F seeks reassurance about costs while using AI Spam detection, to which Saif responds that no costs apply when using Discourse-hosted LLMs via the ‘What’s New’ experiments, but third-party LLMs (e.g., OpenAI, Claude) may incur charges per provider terms. Joe_F thanks Saif for the clarification.

Hey,

We have both CDCK Hosted LLMs and CDCK Hosted embeddings preconfigured in our hosted instance (which is great). Are these free to use and is there a usage limit (other than fair use)? I couldn’t really see much about that on the pricing page and when the question was asked in Debugging AI chat - #4 by Eric_Platzek it wasn’t really answered.

Thanks a lot!

The CDCK-hosted LLMs are available experimentally for any hosted sites that opt in via the toggle under the “What’s New” feed. During this phase, there is no extra cost and no usage limit other than fair use.

As for CDCK-hosted embeddings models, these have been live for our hosted customers for over a year now, but only recently became visible in the UI with the newly created “Embeddings” tab under AI configuration. This is not experimental and is offered as part of our hosting service.

Great, thank you!
I assume we’d get an email or some other notification if this changes for the LLMs and it would tell us what the cost would be?

Yes, any changes would mean closing down the existing experiments and creating a whole new offer.

Sorry if this has been asked / answered anywhere else.

Are there any costs incurred with these LLM’s at the moment?

I have enabled the AI Spam detection, noticed the tokens being used, I just want to ensure I am not incurring costs.

Thanks Joe

No costs are incurred if you are using Discourse hosted LLMs via the What’s New experiments

If you use a 3rd party LLM such as OpenAI, Claude etc, then you will need to check with the respective provider for costs

Thank you @Saif