The default Admin/Moderator/Staff groups have Delete button enabled and visible. As far as I know Discourse didn’t allow for deleting these groups. Potentially a bug?
I haven’t dared to click the delete button because I don’t want to screw up the functionality. The delete button is also visible on trust level groups.