Discourse Meta
Google complaining – Indexed, though blocked by robots.txt
Product Support
sam
(Sam Saffron)
November 2, 2018, 5:40am
17
Can you see if this:
Sorts out your problem?
show post in topic
Related topics
Topic
Replies
Views
Activity
Why there are lots of Disallow rule in robots.txt?
Product Support
34
5028
December 22, 2020
Issues Google Search Console is throwing at me for wrong discourse structure (or some for wrong administration of my site)
Product Support
18
441
December 18, 2024
Pages listed in the robots.txt are crawled and indexed by Google
Product Support
18
3642
July 30, 2019
Why isn't Google Indexing Discourse? SEO concerns
Product Support
seo
31
6482
June 1, 2024
Google indexing issue (robots.txt)
Product Support
7
861
April 18, 2020