See the second to last reply in that topic: Needing to edit robots.txt file - where is it? - #42 by Osama.
jomaxro
(Joshua Rosenfeld)
2
Related topics
| 글 | 댓글 | 조회수 | 활동 | |
|---|---|---|---|---|
| How to disable indexing by crawlers | 15 | 5385 | 1월 18, 2017 | |
| Pages listed in the robots.txt are crawled and indexed by Google | 18 | 3442 | 7월 30, 2019 | |
| Excluding user profiles in robots.txt (or allow edit of file) | 4 | 2580 | 5월 24, 2014 | |
| Need to find a solution to block indexing topics from a category | 2 | 138 | 11월 27, 2024 | |
| Malformed robots.txt causing issues with indexing | 7 | 1954 | 9월 14, 2019 |