Can categories be viewed by others who don't have the access authority?

Isn’t that what you wanted?

Perhaps you want to make a normal user account. It will see only the categories that it has permission to read.