So why not create a new group that only the publishing user is a member of which has access to both? More than one group can have permissions on a single category, your response details posts and categories but really needs to explain the users and groups in play here if we’re going to be able to hand-hold you any further.