At the moment there is no such feature. Not against it, but it is very subtle to explain:
We have:
“Show badge on the public badges page”
We would have to add
“Show all users with this badge on the public badge page”
There is a big question though, are you protecting against anything with such a feature?
People can still scrape your user list to figure out the full list of users with a particular badge.