Discourse Meta
Excluding user profiles in robots.txt (or allow edit of file)
ميزة
codinghorror
(Jeff Atwood)
24 مايو 2014، 4:19ص
5
User profiles are now disallowed from indexing by default.
إعجابَين (2)
Generic rules in "robots.txt" not picked up by Googlebot
إظهار المنشور في الموضوع
الموضوعات ذات الصلة
الموضوع
الردود
مرات العرض
النشاط
How to edit robot.txt for indexing user profiles?
Support
9
901
8 يونيو 2023
Pages listed in the robots.txt are crawled and indexed by Google
Support
19
3270
30 يوليو 2019
Indexing User Profiles
Support
2
56
4 سبتمبر 2025
Why there are lots of Disallow rule in robots.txt?
Support
34
4546
22 ديسمبر 2020
Generic rules in "robots.txt" not picked up by Googlebot
Support
6
997
2 أبريل 2022