What happens to translations when LLM changes?

Support
1

If I change the LLM do all the posts get retranslated?

I was using a LLM hosted on groq, it was about 95% done when I started getting errors. After investigating it I realized that groq had deprecated the model I was using. So I setup a new model in groq and then updated the model parameters in discourse.

I see that discourse is now using millions of tokens with the updated translation LLM every single day but the progress bar in the translations status page isn’t progressing at all (still stuck at 95%).

So I’m trying to figure out what happens when the LLM parameters change? Does it start the translations all over again from scratch? If so is there any way to prevent it from doing that and just picking up from where it left off?

2

It depends. For example, if you translate using a Gemini model and then switch to another, you’ll be creating a new word cache. In my experience, I prefer to maintain three routes: two with the same model, and I’ve now activated a Gemini Flash Lite for new content. So far, no issues.

3

Old translations are kept, new LLM will only do translations for what wasn’t translated so far.