Discourse Meta
Google changed how they process robots.txt in Discourse?
Поддержка
codinghorror
(Jeff Atwood)
22.Декабрь.2020 06:02:40
21
We should probably backport this.
2 лайка
← предыдущая страница
Связанные темы
Тема
Ответов
Просм.
Активность
Pages listed in the robots.txt are crawled and indexed by Google
Support
19
3303
30.07.2019
Google notification to remove "noindex" statements from robots.txt
Support
8
2452
30.07.2019
Google complaining – Indexed, though blocked by robots.txt
Support
24
2518
28.09.2023
Issues Google Search Console is throwing at me for wrong discourse structure (or some for wrong administration of my site)
Support
18
209
18.12.2024
Generic rules in "robots.txt" not picked up by Googlebot
Support
6
1010
02.04.2022