I also noticed this happening if I invite a user to a PM. I have the
suppress uncategorized badge setting disabled.
(I renamed “uncategorized” to “other.”) Normally the badge isn’t visible for PMs, but after editing the first message in any way it seems to appear. The first time this happened I thought I’d accidentally made the message public somehow.