is there any tool to split input text into chunks? or which embedding api support more than 8192 tokens? i am using Qwen/Qwen3-Embedding-0.6B Message (15 copies reported) OpenAI Embeddings failed with status: 413 body: {"code":20042,"message":"input must have less than 8192 tokens","data":null} …

Warning of embedding `input must have less than 8192 tokens` with discourse ai

whitewaterdeu (mocha3901) November 3, 2025, 8:10am 6

ok , i am asking api provider

1 Like

Topic		Replies	Views
Embedding of post is not being properly truncated in discourse-ai plugin Bug ai	5	407	August 20, 2023
Ai:embeddings:backfill - Handling OpenAI's 400 Error for Excessive Tokens in Embeddings Bug ai	10	867	March 15, 2024
Adding Semantic Search feature for our self-hosted discourse site Support ai , ai-search	9	191	March 19, 2025
Gemini API Embedding Configuration Clarification Support ai	4	114	November 15, 2025
Something bad with embeddings (related topics getting too costly) Bug ai , related-topics	21	188	January 5, 2025