I am unclear. What you wrote sounds correct to me, if the mod has no replies in the PM, they would not have access after conversion to PM. That is expected.
What is incorrect would be The mod having access even if the mod made no posts in that topic prior to it being converted to a PM. That would be unexpected.