This is a cool idea. If I might make a suggestion?
A good option would be to have a blacklist available to group owners in the event they need to remove a member for issues. With a message if someone tries to reinvite they see a notification “x user is banned; contact group owners”