Just testing this again today and realized that it actually does work now. If a user is allowed to invite and is a group owner, they see the “Add to groups” option on the “advanced mode” invite popup, and can select their own group there.
I guess I had to do a hard refresh or wait for some process to complete to give the user access.