One case I’ve come across is that the setting may prevent custom fonts that have been added to a site’s theme from loading for anonymous users. Other than that, I haven’t been able to find unexpected issues with the setting.
If possible, it would be good to improve that setting’s description. If anyone has more details about issues that it causes for anonymous users, please let me know.