Permissions are effectively cumulative, there’s no such thing as a conflict in that sense. The highest inherited permission always wins. I can be added to one group which lets me see a category, and also another which lets me contribute.
Why would you need to exclude a group unless you’ve also explicitly given access through another membership?