is there any tool to split input text into chunks? or which embedding api support more than 8192 tokens? i am using Qwen/Qwen3-Embedding-0.6B Message (15 copies reported) OpenAI Embeddings failed with status: 413 body: {"code":20042,"message":"input must have less than 8192 tokens","data":null} …

Warning of embedding `input must have less than 8192 tokens` with discourse ai

whitewaterdeu (mocha3901) 3 בנובמבר,‏ 2025,‏ 8:10am 6

ok , i am asking api provider

לייק 1

נושא		תגובות	צפיות
Embedding of post is not being properly truncated in discourse-ai plugin Bug ai	5	412	20 באוגוסט,‏ 2023
Ai:embeddings:backfill - Handling OpenAI's 400 Error for Excessive Tokens in Embeddings Bug ai	10	883	15 במרץ,‏ 2024
Adding Semantic Search feature for our self-hosted discourse site Support ai , ai-search	9	216	19 במרץ,‏ 2025
Gemini API Embedding Configuration Clarification Support ai	4	216	15 בנובמבר,‏ 2025
Something bad with embeddings (related topics getting too costly) Bug related-topics , ai	21	214	5 בינואר,‏ 2025