Another observation here to consider when refining the proposed solution here:
I think this is problematic.
It would be preferable IMHO if the design encouraged those users could just “star” or “favorite” that one category, instead of having mute all the others.