is there any tool to split input text into chunks? or which embedding api support more than 8192 tokens? i am using Qwen/Qwen3-Embedding-0.6B Message (15 copies reported) OpenAI Embeddings failed with status: 413 body: {"code":20042,"message":"input must have less than 8192 tokens","data":null} …

If you self-host that same model, it can take up to 32k tokens. It is what we run on our hosting these days. If that’s out of the question, then you need to configure the embeddings model to limit inputs to the maximum allowed on your provider. This way, our AI Bot RAG will split uploaded files int…

how to configure embedding model? in discourse ?or model provider?

i am sure Qwen/Qwen3-Embedding-0.6B support up to 32k tokens and i have configured sequence length 32k [image] [image] but there still are many error of embedding [image] [image] [image]

[画像] whitewaterdeu: i am sure Qwen/Qwen3-Embedding-0.6B support up to 32k tokens It does if your API providers allows it. [画像] whitewaterdeu: but there still are many error of embedding If your API provider limits it to 8192, you gotta follow their rules.

discourse ai で `input must have less than 8192 tokens` が発生する警告

サポート

whitewaterdeu (mocha3901) 2025 年 11 月 2 日午前 2:56 3

Discourse で埋め込みモデルを構成する方法は？またはモデルプロバイダーで？

トピック		返信	表示
Embedding of post is not being properly truncated in discourse-ai plugin Bug ai	5	417	2023 年 8 月 20 日
Ai:embeddings:backfill - Handling OpenAI's 400 Error for Excessive Tokens in Embeddings Bug ai	10	897	2024 年 3 月 15 日
Adding Semantic Search feature for our self-hosted discourse site Support ai , ai-search	9	233	2025 年 3 月 19 日
Gemini API Embedding Configuration Clarification Support ai	4	275	2025 年 11 月 15 日
Something bad with embeddings (related topics getting too costly) Bug related-topics , ai	21	230	2025 年 1 月 5 日

discourse ai で `input must have less than 8192 tokens` が発生する警告

関連トピック