Add "noindex" on tag pages

Product Support

AI-generated summary

The discussion revolves around adding a “noindex” meta tag to tag pages on a Discourse forum to prevent them from being indexed by Google. porcorosso initiated the conversation, seeking help on how to add the <meta name="robots" content="noindex" /> tag. However, Falco revealed that tag and user pages are already on the noindex list by default. spa countered that their forum’s tag and user pages did not have the noindex tag, prompting Falco to explain that the noindex directive is delivered through both the response header and the robots.txt file.

1

Hi guys,

I decided to use tags on discourse. But i don’t want tags to be indexed by google…

So I wonder how to add the “noindex” Robots meta tag on tag pages.

<meta name="robots" content="noindex" />

Thanks !

2

In the same boat here with Tag pages and User pages

3

Tag and User pages are already on the noindex list.

4

Hm. Ours doesn’t seem to have noindex tags on both Tag and User pages. I didn’t set up the forum, so I’m not sure if whoever did tinkered around with this. Where can I alter this?

6

The noindex directive is delivered via both the response header and in the robots.txt file:

➜  ~ curl https://meta.discourse.org/tag/planned -I -X GET
HTTP/2 200 
date: Tue, 09 Feb 2021 14:38:52 GMT
...
x-robots-tag: noindex
...

➜  ~ curl https://meta.discourse.org/u/Falco -I -X GET
HTTP/2 200 
date: Tue, 09 Feb 2021 14:39:38 GMT
...
x-robots-tag: noindex
...

https://meta.discourse.org/robots.txt

User-agent: *
...
Disallow: /u
Disallow: /my
Disallow: /tag
...