Get API Key only for adding/removing users from a group

See Granular API key restriction missing a lot of endpoints - #2 by pfaffman.

Seems like the same question? (You were probably first)