Yes, if all image extensions are removed from the authorized extensions site setting, users will not be able to upload avatars.
To allow users to set custom avatars but not allow them to upload image files, you could point your users to https://en.gravatar.com/. Gravatars that are set for an email address will be used as the user’s avatar on Discourse.