I just installed this lovely plugin and came here to add just this bit of feedback. 
I can see it being tricky to implement though, not even knowing the technical issues. For example, I have tag groups for years, people, places etc that all sensibly could be given the same icon and color, but then also have other specific tags that will want their own specific icon and color.