Restricting particular tags by /group, even within a "Tag Grouping"

Continuing the discussion from Tag management for non-staff:

I’m looking for possibilities in restricting particular tags within tag grouping even further by Trust Level / Group. This is related to particular tags triggering various chat-integrations + attempting to limit our number of categories in favor of a focus on useful tags and opt-in group association.