is there any tool to split input text into chunks? or which embedding api support more than 8192 tokens? i am using Qwen/Qwen3-Embedding-0.6B Message (15 copies reported) OpenAI Embeddings failed with status: 413 body: {"code":20042,"message":"input must have less than 8192 tokens","data":null} …

Warning of embedding `input must have less than 8192 tokens` with discourse ai

whitewaterdeu (mocha3901) November 3, 2025, 8:10am 6

ok , i am asking api provider

Topic		Replies	Views
Embedding of post is not being properly truncated in discourse-ai plugin Bug ai	5	407	August 20, 2023
Gemini API Embedding Configuration Clarification Support ai	3	87	October 16, 2025
Ai:embeddings:backfill - Handling OpenAI's 400 Error for Excessive Tokens in Embeddings Bug ai	10	866	March 15, 2024
Adding Semantic Search feature for our self-hosted discourse site Support ai , ai-search	9	189	March 19, 2025
Something bad with embeddings (related topics getting too costly) Bug related-topics , ai	21	185	January 5, 2025