See the second to last reply in that topic: Needing to edit robots.txt file - where is it?.
jomaxro
(Joshua Rosenfeld)
2
נושאים קשורים
| נושא | תגובות | צפיות | פעילות | |
|---|---|---|---|---|
| How to disable indexing by crawlers | 17 | 5224 | 24 באפריל, 2019 | |
| Pages listed in the robots.txt are crawled and indexed by Google | 19 | 3335 | 30 ביולי, 2019 | |
| Excluding user profiles in robots.txt (or allow edit of file) | 5 | 2531 | 24 במאי, 2014 | |
| Need to find a solution to block indexing topics from a category | 2 | 83 | 27 בנובמבר, 2024 | |
| Malformed robots.txt causing issues with indexing | 9 | 1882 | 21 באפריל, 2023 |