Discourse Meta
Excluding user profiles in robots.txt (or allow edit of file)
Característica
codinghorror
(Jeff Atwood)
24 Mayo, 2014 04:19
5
User profiles are now disallowed from indexing by default.
2 Me gusta
Generic rules in "robots.txt" not picked up by Googlebot
mostrar publicación en el tema
Temas relacionados
Tema
Respuestas
Vistas
Actividad
How to edit robot.txt for indexing user profiles?
Support
9
901
8 Junio 2023
Pages listed in the robots.txt are crawled and indexed by Google
Support
19
3270
30 Julio 2019
Indexing User Profiles
Support
2
56
4 Septiembre 2025
Why there are lots of Disallow rule in robots.txt?
Support
34
4546
22 Diciembre 2020
Generic rules in "robots.txt" not picked up by Googlebot
Support
6
997
2 Abril 2022