Discourse Meta
Robots.txt to completely block all indexing of private site
Ondersteuning
jomaxro
(Joshua Rosenfeld)
5 maart 2020 om 17:46
2
See the second to last reply in that topic:
Needing to edit robots.txt file - where is it?
.
5 likes
bericht weergeven in topic
Gerelateerde topics
Topic
Antwoorden
Weergaven
Activiteit
How to disable indexing by crawlers
Support
17
5142
24 april 2019
Pages listed in the robots.txt are crawled and indexed by Google
Support
19
3250
30 juli 2019
Excluding user profiles in robots.txt (or allow edit of file)
Feature
5
2493
24 mei 2014
Need to find a solution to block indexing topics from a category
Support
2
50
27 november 2024
Malformed robots.txt causing issues with indexing
Support
9
1835
21 april 2023