How to limit user chosing flair?

You might want to consider this theme component.

It gives Trust Level flairs and still allows other flairs.

Otherwise I think you can turn off choosing flairs by disabling choosing primary group.