Its totally possible there is another bug here, but it looks like something different, @downey if easily reproducible this should be in its own topic.
Have a look at mail logs in admin, are there duplicates there to the user? 2 reply keys for the same email?