Could a compromise be that actions related to a specific post in a restricted category just display as private or even better show to users with rights to see that post?
Alternatively just turn off the info displayed about the reason for the badge via a setting.
The admins can dig around in the database if needed. I know some users will game the system but who cares? The goal is to reward good behavior. The bad guys are winning under the current system.