TL;DR pick the closest tokenizer and set the maximum context to some thousands less to allow for the difference to not affect you.
Falco
(Falco)
2
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Adding Semantic Search feature for our self-hosted discourse site | 9 | 253 | March 19, 2025 | |
| Frustrations on AI spam detector | 9 | 137 | December 21, 2025 | |
| Configuring OpenRouter language models | 0 | 1033 | December 10, 2024 | |
| How to implement Mistral with Embeddings | 6 | 228 | May 11, 2025 | |
| Inquiry About AI Plugin Options | 7 | 133 | November 24, 2025 |