is there any tool to split input text into chunks? or which embedding api support more than 8192 tokens? i am using Qwen/Qwen3-Embedding-0.6B Message (15 copies reported) OpenAI Embeddings failed with status: 413 body: {"code":20042,"message":"input must have less than 8192 tokens","data":null} …

Warning of embedding `input must have less than 8192 tokens` with discourse ai

whitewaterdeu (mocha3901) 3 november 2025 om 08:10 6

ok , i am asking api provider

1 like

Topic		Antwoorden	Weergaven
Embedding of post is not being properly truncated in discourse-ai plugin Bug ai	5	407	20 augustus 2023
Ai:embeddings:backfill - Handling OpenAI's 400 Error for Excessive Tokens in Embeddings Bug ai	10	870	15 maart 2024
Adding Semantic Search feature for our self-hosted discourse site Support ai , ai-search	9	191	19 maart 2025
Gemini API Embedding Configuration Clarification Support ai	4	135	15 november 2025
Something bad with embeddings (related topics getting too costly) Bug ai , related-topics	21	191	5 januari 2025