You can hide the profile by selecting “Hide my public profile and presence features” on the Preferences/Interface page of the anonymous user, if that’s any use in the short term?
Though I think users could still do an @mention search for the anon username, and pull up all their posts that way.