This confusion has come up before… we use a Font Awesome icon for the reaction button, despite using emoji for the reactions themselves.
I’ve just opened a PR to clarify this in the setting description:
https://github.com/discourse/discourse-reactions/pull/257
So it will say
Defines the icon used for the main reaction button. This should be a Font Awesome icon name, not an emoji name.