Thanks, but I know what a tokenizer is. What I don’t know is what Discourse uses it for, and what would happen if I picked the wrong tokenizer? I don’t need a tokenizer to call an LLM anyway.
lilydjwg
3
Gerelateerde topics
| Topic | Antwoorden | Weergaven | Activiteit | |
|---|---|---|---|---|
| Discourse AI - Large Language Model (LLM) settings page | 20 | 3724 | 9 mei 2026 | |
| AI powered Spam detection | 11 | 1129 | 11 januari 2025 | |
| Discourse AI - Spam detection | 30 | 4333 | 10 maart 2026 | |
| Introducing Discourse AI | 26 | 4040 | 4 mei 2023 | |
| What's the cheapest/best AI to use for AI Spam? | 6 | 362 | 18 maart 2025 |