Square Emoji site setting does not work as expected

[cpradio]

@gkln

So, what is the purpose of this setting?

To not square them at upload. To fix the CSS you will need to apply your own CSS rule overriding the existing one in the Admin > Customize section.