We do not use secret groups.
Since trust by trancparency is the goal in our situation, I would show all groups able to read a category in the infobox.
For special cases, I could imagine the need to have group names obfuscated, but I would still show, that there is a group defined, who can access the category.
Propose a (configurable) solution, if you like to have something implemented.