Is there an API scope which covers operations relating to groups?

If I understand correctly you want an API scope for adding and removing users to groups. There is one for adding users and removing users.