Translator translates topic into different language!

Contribute Bug

AI-generated summary

A discussion on Meta’s new Translate feature highlights a bug where a post originally written in English is incorrectly translated into Spanish. NateDhaliwal reports that the translation occurs when the topic appears to be in Finnish, despite the content being in English. The issue seems to stem from the language detection system misclassifying the language. Sam notes a similar problem, and Nat confirms it’s due to the LLM misclassifying the language, likely after upgrading to version 4.1 nano. The team plans to address the issue by tracking misclassifications and improving the prompt, and has already purged the erroneous data for the affected post.

1

This relates to Meta’s new Translate feature that auto-translates topics, but I’m quite sure the following is a bug.

Upon entering a topic that was seemingly not written in English, but suomi, according to the message on clicking the translate icon next to to the topic creation date.

However, the whole post is now written in Spanish, I believe due to the Translator.

Upon clicking the translate button at the bottom (which I have no idea what it does), the post is translated to English, and the aforementioned translate icon disappears.

So surely the post isn’t meant to be translated into Spanish? Other posts seem to be translated from its original language to English, but not this one?

To make it easier, I have recorded this in a video:

If you look at the raw post, it was written in English. Why then should Translator translate this post?

The image is a screenshot of a text message discussing issues with a forum about Finnish speakers on meta.discourse.org, mentioning problems with scrolling through the search experience and whether these issues might originate from AI. (Captioned by AI)
The image is a screenshot of a text message discussing issues with a forum about Finnish speakers on meta.discourse.org, mentioning problems with scrolling through the search experience and whether these issues might originate from AI. (Captioned by AI)1080×2408 172 KB

3 Likes
2

I also saw something odd here @nat on a diff topic, maybe something regressed here?

4 Likes
3

Hmm no regression.. it’s our LLM misclassifying the language. It tends to do that every now and then.

For now we have to track all these misclassifications and improve the prompt. I think we switched our LLM to 4.1 nano a week back, and this issue popped up a lot more.

I’ll purge the data for that post as well.

7 Likes