You need low latency for interactive use cases like that, so models like Gemini Flash are optimal.
Falco
(Falco)
2
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| What LLM to use for Discourse AI? | 0 | 816 | January 23, 2025 | |
| Discord search on Discourse AI | 3 | 251 | October 3, 2025 | |
| Discourse AI plugin: missing model discovery & sensible defaults (any plans or community plugins?) | 4 | 75 | February 3, 2026 | |
| Conversational AI Search coming to Discourse AI | 15 | 987 | December 16, 2025 | |
| Adding Semantic Search feature for our self-hosted discourse site | 9 | 253 | March 19, 2025 |