Oh gosh, that really works 
It seems that I hope to use the group icon for a different purpose than most people - I am not really using them as flairs but as “avatars” for the groups.
I like your suggestion to clarify that point, but in the meantime thank you very much for the pointers.