Discourse Meta
Robots.txt to completely block all indexing of private site
Support
jomaxro
(Joshua Rosenfeld)
March 5, 2020, 5:46pm
2
See the second to last reply in that topic:
Needing to edit robots.txt file - where is it?
.
5 Likes
show post in topic
Related topics
Topic
Replies
Views
Activity
Excluding user profiles in robots.txt (or allow edit of file)
Feature
5
2468
May 24, 2014
Pages listed in the robots.txt are crawled and indexed by Google
Support
19
3205
July 30, 2019
Google notification to remove "noindex" statements from robots.txt
Support
8
2402
July 30, 2019
Google changed how they process robots.txt in Discourse?
Support
20
1577
December 22, 2020
Malformed robots.txt causing issues with indexing
Support
9
1738
April 21, 2023