Discourse Meta
Robots.txt to completely block all indexing of private site
Support
jomaxro
(Joshua Rosenfeld)
March 5, 2020, 5:46pm
2
See the second to last reply in that topic:
Needing to edit robots.txt file - where is it?
.
5 Likes
show post in topic
Related topics
Topic
Replies
Views
Activity
How to disable indexing by crawlers
Support
17
5116
April 24, 2019
Pages listed in the robots.txt are crawled and indexed by Google
Support
19
3234
July 30, 2019
Excluding user profiles in robots.txt (or allow edit of file)
Feature
5
2482
May 24, 2014
Need to find a solution to block indexing topics from a category
Support
2
42
November 27, 2024
Malformed robots.txt causing issues with indexing
Support
9
1811
April 21, 2023