I believe though the Op is looking for a way to display what group(s) have the see permission. As they mentioned as admin they can get the info. A group owner is not likely going to be a new member of a forum. 
I imagine with some CSS it might be able to add to closed categories? To have it show group see access.