Google changed how they process robots.txt in Discourse?

codinghorror (Jeff Atwood) 2020 年 12 月 22 日午前 6:02 21

We should probably backport this.

「いいね！」 2

トピック		返信	表示
Pages listed in the robots.txt are crawled and indexed by Google Support	19	3250	2019 年 7 月 30 日
Google notification to remove "noindex" statements from robots.txt Support	8	2431	2019 年 7 月 30 日
Google complaining – Indexed, though blocked by robots.txt Support	24	2488	2023 年 9 月 28 日
Issues Google Search Console is throwing at me for wrong discourse structure (or some for wrong administration of my site) Support	18	147	2024 年 12 月 18 日
Google search indexing not working? Support seo	0	46	2025 年 3 月 23 日