Glad you figured it out! ![]()
Yes, that setting is intended to be quite restrictive I believe (hence the ALL CAPS warning in the instructions).
To allow your wordpress instance through while using allowed crawler user agents, you can add it like so:
Wordpress/<wordpress_version>
I just tested this out on my test Wordpress / Discourse by adding Wordpress/5.5.3 to allowed crawler user agents and it worked ![]()
If you don’t want to keep updating that every time you upgrade your wordpress you can use a simple plugin to set your own user agent for these type of requests in Wordpress, e.g.