Limit tag-groups to certain groups

It might not help but your could limit tags to a category and then limit that category to a group.