Discourse Meta
Excluding user profiles in robots.txt (or allow edit of file)
Funzionalità
codinghorror
(Jeff Atwood)
24 Maggio 2014, 4:19am
5
User profiles are now disallowed from indexing by default.
2 Mi Piace
Generic rules in "robots.txt" not picked up by Googlebot
mostra messaggio in argomento
Argomenti correlati
Argomento
Risposte
Visualizzazioni
Attività
How to edit robot.txt for indexing user profiles?
Support
9
901
Giugno 8, 2023
Pages listed in the robots.txt are crawled and indexed by Google
Support
19
3270
Luglio 30, 2019
Indexing User Profiles
Support
2
56
Settembre 4, 2025
Why there are lots of Disallow rule in robots.txt?
Support
34
4546
Dicembre 22, 2020
Generic rules in "robots.txt" not picked up by Googlebot
Support
6
997
Aprile 2, 2022