Option for user to delete themselves?

I think you are indeed missing something. Try signing up as a new user on your own Discourse instance, then visit the profile page. There will be a delete option.

This new user self delete option goes away after a few days, or if the user creates a number of posts (see your site settings for details).