Hello there, I’ve enabled Discourse AI on our community forum and started backfilling into multiple languages. Around 60% of posts and topics are translated, but in the process, I’m getting a LOT of errors in the console (ai_translation_verbose_logs is enabled) and now backfilling has mostly stalle…

I’ve found ai_api_audit_logs and I think I’ve found the issue. When translation is sent, there’s a get_max_tokens function which assigns max tokens based on text length. Problem is, it’s mostly used up by reasoning. See this audit log, the limit was set to 1000, and reasoning took the whole 1000 b…

[imagem] panrafal: Problem is, it’s mostly used up by reasoning. I simply do not recommend using any type of thinking models for translation tasks. [imagem] Nuenki | The more LLMs think, the worse they translate Testing LLMs across multiple different thinking strategies demonstra…

[imagem] Falco: I simply do not recommend using any type of thinking models for translation tasks. My experience is quite the opposite. I have a set of instructions that I want to be followed that require understanding the context, which are either ignored by non-thinking models, or applied i…

[imagem] panrafal: I reduced thinking effort to low based on my findings and got all the translations come through. But I believe limiting the output tokens like that is counter-productive, as thinking models are not restricted from being used in translations, and user have no clue why it’s fail…

[imagem] Falco: I believe the newer version of OpenAI Responses API applies max_tokens without counting the thinking tokens, which solves this issue. I’m trying the latest GPT-5. I saw exactly the same issue with Gemini 2.5 Pro and 2.5 Flash. Why not to just increase the limit a bit? I’ve sp…

I disabled the streaming and it made it much better (and still does thinking)

We just merged an update that gives you access to a new setting ai_translation_max_tokens_multiplier which defaults to 1. You should be able to bump this up to any number you like to deal with the limit you’re seeing. https://github.com/discourse/discourse/pull/35859

Discourse AI falhando ao traduzir grande número de posts e tópicos

Suporte

Falco (Falco) Outubro 13, 2025, 12:52pm 3

Eu simplesmente não recomendo o uso de nenhum tipo de modelo de pensamento para tarefas de tradução.

https://www.reddit.com/r/LocalLLaMA/comments/1g7y74t/adding_a_thinking_turn_to_extend_llms_reasoning/

Tópico		Respostas	Visualizações
AI translations errors Bug ai	10	176	10 de Maio de 2026
AI translation backfill not working after all settings configured Support ai , content-localization	35	747	17 de Novembro de 2025
What happens to translations when LLM changes? Support ai	12	251	8 de Maio de 2026
The usage problem after using AI translation Support ai , dynaloc	7	223	15 de Julho de 2025
AI exceeds LLM token thresholds randomly and unpredictably Support ai	3	91	6 de Maio de 2026

Discourse AI falhando ao traduzir grande número de posts e tópicos

Tópicos relacionados