Google Not Indexing Discourse Forum – Sitemap Not Approved

[Michael82]

Thanks for pointing that out! I wasn’t aware that Google uses other crawlers that don’t explicitly declare Googlebot.

I’ll clear the allowed_crawler_user_agents list to avoid accidentally blocking anything.