Hello there, I’ve enabled Discourse AI on our community forum and started backfilling into multiple languages. Around 60% of posts and topics are translated, but in the process, I’m getting a LOT of errors in the console (ai_translation_verbose_logs is enabled) and now backfilling has mostly stalle…

I’ve found ai_api_audit_logs and I think I’ve found the issue. When translation is sent, there’s a get_max_tokens function which assigns max tokens based on text length. Problem is, it’s mostly used up by reasoning. See this audit log, the limit was set to 1000, and reasoning took the whole 1000 b…

[תמונה] panrafal: Problem is, it’s mostly used up by reasoning. I simply do not recommend using any type of thinking models for translation tasks. [תמונה] Nuenki | The more LLMs think, the worse they translate Testing LLMs across multiple different thinking strategies demonstrate…

[תמונה] Falco: I simply do not recommend using any type of thinking models for translation tasks. My experience is quite the opposite. I have a set of instructions that I want to be followed that require understanding the context, which are either ignored by non-thinking models, or applied in…

[תמונה] panrafal: I reduced thinking effort to low based on my findings and got all the translations come through. But I believe limiting the output tokens like that is counter-productive, as thinking models are not restricted from being used in translations, and user have no clue why it’s faili…

[תמונה] Falco: I believe the newer version of OpenAI Responses API applies max_tokens without counting the thinking tokens, which solves this issue. I’m trying the latest GPT-5. I saw exactly the same issue with Gemini 2.5 Pro and 2.5 Flash. Why not to just increase the limit a bit? I’ve spe…

I disabled the streaming and it made it much better (and still does thinking)

We just merged an update that gives you access to a new setting ai_translation_max_tokens_multiplier which defaults to 1. You should be able to bump this up to any number you like to deal with the limit you’re seeing. FEATURE: Add a multiplier for…

Discourse AI Failing to translate large number of posts and topics

תמיכה

Falco (Falco) 13 באוקטובר,‏ 2025,‏ 12:52pm 3

I simply do not recommend using any type of thinking models for translation tasks.

https://www.reddit.com/r/LocalLLaMA/comments/1g7y74t/adding_a_thinking_turn_to_extend_llms_reasoning/

נושא		תגובות	צפיות
AI translation backfill not working after all settings configured Support ai , content-localization	35	629	17 בנובמבר,‏ 2025
The usage problem after using AI translation Support dynaloc , ai	7	168	15 ביולי,‏ 2025
Why Is the Discourse AI Translation Icon Not Appearing? Support content-localization , ai	7	192	5 באוקטובר,‏ 2025
Questions about Discourse AI automatic translation Community Building	4	128	2 בפברואר,‏ 2026
AI Translation skips Portuguese (pt) locale - post translated to all languages except Portuguese Bug ai , dynaloc	25	179	22 באפריל,‏ 2026

Discourse AI Failing to translate large number of posts and topics

נושאים קשורים