If you want them to view the categories but not read the topics I do not believe this can be done. Otherwise if you want them to be able to read the posts you just need to set the everyone group to read I believe.
But I think I see what you are saying is that some people may not want to see those categories - so in fact that will not actually help as setting everyone to read all categories would overwrite the fact they are in a group.