I would love to use this feature too, but can’t delete profile pics for those who have already uploaded one.
Tight control is not the only valid use case. My site encourages photos but in the absence of photos, we would at least like to be able to visually differentiate users at a glance. The colored letters don’t do that very well; avatars from a list would do it much better.