Unable to anonymize user via API with SSO enabled

I’m going to reply my self as I found out what was wrong with the call.
Seems like the admin and moderators account can not be deleted or anonymized. And this was the case with my test account.
Might be nice to mention this in the API documentation at some point.