Hi. I’ve seen the discussion at: [imagem] Needing to edit robots.txt file - where is it? support You are completely hijacking a topic here that is asking for removal of items from the Google index. Feel free to open a dedicated topic to discuss this. There are changes we…

See the second to last reply in that topic: Needing to edit robots.txt file - where is it? .

Ah, missed that one down there. Perfect. Worked like a charm. Thanks!

Also, make sure you have the login required setting turned on by rerunning the wizard at discourse.yoursite.com/wizard . That will also shut out search engines.

The site has always required login, and does not permit user self-registration. However, it has still been showing up in search engines – just with no content indexed since it couldn’t log in. My hope is that with robots.txt blocking explicitly, any mention will cease. Thanks.

Robots.txt para bloquear completamente a indexação de site privado

Suporte

jomaxro (Joshua Rosenfeld) Março 5, 2020, 5:46pm 2

Veja a segunda a última resposta nesse tópico: Needing to edit robots.txt file - where is it? - #42 by Osama.

Tópico		Respostas	Visualizações
How to disable indexing by crawlers Support	17	5215	24 de Abril de 2019
Pages listed in the robots.txt are crawled and indexed by Google Support	19	3334	30 de Julho de 2019
Excluding user profiles in robots.txt (or allow edit of file) Feature	5	2529	24 de Maio de 2014
Need to find a solution to block indexing topics from a category Support	2	83	27 de Novembro de 2024
Malformed robots.txt causing issues with indexing Support	9	1882	21 de Abril de 2023

Robots.txt para bloquear completamente a indexação de site privado

Tópicos relacionados