We are a bit of a special case, in that our entire company needs to be very capable discourse admins. In practice we let all our staff be admins in meta and have never really had any issues due to this.
That said in your case you could keep a select few admins and make the rest moderators, all the workflows we use internally would also work for you (assign/whispers etc)
Safest thing for you to do, only give admin to people that need it, give moderator to the rest.