This is an eager typographer replacement; it happens here too, but the default markdown_typographer_quotation_marks are different on a non-French instance.
You can disable enable_markdown_typographer or set the quotation marks site setting to a different default.
That said, I feel there are some quick wins we can make to improve this experience. We’ll look into those. The site settings are immediate alternatives.