Excluding user profiles in robots.txt (or allow edit of file)

codinghorror (Jeff Atwood) 2014 年5 月 24 日 04:19 5

User profiles are now disallowed from indexing by default.

2 个赞

话题		回复	浏览量
How to edit robot.txt for indexing user profiles? Support	7	1009	2023 年4 月 5 日
Pages listed in the robots.txt are crawled and indexed by Google Support	18	3401	2019 年7 月 30 日
Indexing User Profiles Support	2	96	2025 年9 月 4 日
Why there are lots of Disallow rule in robots.txt? Support	34	4735	2020 年12 月 22 日
Generic rules in "robots.txt" not picked up by Googlebot Support	5	1042	2022 年3 月 3 日