Hello there, I’ve enabled Discourse AI on our community forum and started backfilling into multiple languages. Around 60% of posts and topics are translated, but in the process, I’m getting a LOT of errors in the console (ai_translation_verbose_logs is enabled) and now backfilling has mostly stalle…

I’ve found ai_api_audit_logs and I think I’ve found the issue. When translation is sent, there’s a get_max_tokens function which assigns max tokens based on text length. Problem is, it’s mostly used up by reasoning. See this audit log, the limit was set to 1000, and reasoning took the whole 1000 b…

[圖片] panrafal: Problem is, it’s mostly used up by reasoning. I simply do not recommend using any type of thinking models for translation tasks. [圖片] Nuenki | The more LLMs think, the worse they translate Testing LLMs across multiple different thinking strategies demonstrated a co…

[圖片] Falco: I simply do not recommend using any type of thinking models for translation tasks. My experience is quite the opposite. I have a set of instructions that I want to be followed that require understanding the context, which are either ignored by non-thinking models, or applied in wr…

[圖片] panrafal: I reduced thinking effort to low based on my findings and got all the translations come through. But I believe limiting the output tokens like that is counter-productive, as thinking models are not restricted from being used in translations, and user have no clue why it’s failing. …

[圖片] Falco: I believe the newer version of OpenAI Responses API applies max_tokens without counting the thinking tokens, which solves this issue. I’m trying the latest GPT-5. I saw exactly the same issue with Gemini 2.5 Pro and 2.5 Flash. Why not to just increase the limit a bit? I’ve spent …

I disabled the streaming and it made it much better (and still does thinking)

We just merged an update that gives you access to a new setting ai_translation_max_tokens_multiplier which defaults to 1. You should be able to bump this up to any number you like to deal with the limit you’re seeing. https://github.com/discourse/discourse/pull/35859

Discourse AI 无法翻译大量帖子和主题

支持

Falco (Falco) 2025年十月13日 12:52 3

我根本不建议在翻译任务中使用任何类型的思考模型。

https://www.reddit.com/r/LocalLLaMA/comments/1g7y74t/adding_a_thinking_turn_to_extend_llms_reasoning/

話題		回覆	觀看
AI translations errors Bug ai	10	386	2026年五月10日
AI translation backfill not working after all settings configured Support ai , content-localization	34	1281	2025年十一月13日
What happens to translations when LLM changes? Support ai	12	455	2026年五月8日
The usage problem after using AI translation Support ai , dynaloc	7	438	2025年七月15日
AI exceeds LLM token thresholds randomly and unpredictably Support ai	3	196	2026年五月6日

Discourse AI 无法翻译大量帖子和主题

相關主題