is there any tool to split input text into chunks? or which embedding api support more than 8192 tokens? i am using Qwen/Qwen3-Embedding-0.6B Message (15 copies reported) OpenAI Embeddings failed with status: 413 body: {"code":20042,"message":"input must have less than 8192 tokens","data":null} …

嵌入 `input 必须少于 8192 个 token` 的警告与 discourse ai

whitewaterdeu (mocha3901) 2025 年11 月 3 日 08:10 6

ok , i am asking api provider

话题		回复	浏览量
Embedding of post is not being properly truncated in discourse-ai plugin Bug ai	5	407	2023 年8 月 20 日
Gemini API Embedding Configuration Clarification Support ai	3	87	2025 年10 月 16 日
Ai:embeddings:backfill - Handling OpenAI's 400 Error for Excessive Tokens in Embeddings Bug ai	10	866	2024 年3 月 15 日
Adding Semantic Search feature for our self-hosted discourse site Support ai , ai-search	9	189	2025 年3 月 19 日
Something bad with embeddings (related topics getting too costly) Bug related-topics , ai	21	185	2025 年1 月 5 日