Not really, but there is a hacky workaround.
- Create a custom badge
- Configure it to be awarded via group membership
- Put the relevant non-admin people in charge as group managers
- They can then add/remove users from that group, which effectively grants/removes the badge