It looks like this was a bug isolated to clicking create a new topic/reply on unsaved translation changes after minimizing the composer. The dialog warning was showing if you clicked while the composer was still open.
I’ve pushed a fix and it should be deployed here on Meta. I gave it a quick test and it’s working for me, but please do let me know if you encounter any issues!