I have indexed my site to google and get error “No: ‘noindex’ detected in ‘X-Robots-Tag’”. How to remove this header tag?

Community Building Data & reporting

AI-generated summary

Users are discussing issues with Google Search Console reporting a “No: ‘noindex’ detected in ‘X-Robots-Tag’” error on their Discourse sites. Younes_Dev asks how to remove the header tag, and simon suggests checking the allow index in robots txt setting and notes a known fix in Discourse 2.9+. thaidb explains they’ve adjusted their robots.txt to allow indexing of a specific page but still face the error, questioning if another factor is at play. Jagster points out that Disallow rules may override Allow directives in robots.txt. Bathinda questions why only some pages show the error, suggesting it’s inconsistent with a global indexing block.

1

Hi all
I have indexed my site to google and get error “No: ‘noindex’ detected in ‘X-Robots-Tag’”.
How to remove this header tag ?

2

Hi @Younes_Dev, can you check the value of your site’s allow index in robots txt setting?

image
image1221×317 25.7 KB

That setting is enabled by default. If it is enabled on your site and you are still getting the error, what version of Discourse is your site on? There was an issue related to this on some Discourse versions prior to 2.9, but it has been fixed since then: Search engines now blocked from indexing non-canonical pages.

3

Hi everyone,

I’m having trouble getting Google to index a specific page on my Discourse forum (https://nhasg.com.vn/g/Sitetor). Google Search Console reports a “noindex” error, indicating that the page is being blocked from indexing.

Here’s what I’ve tried so far:

  • Modified robots.txt: My initial robots.txt file had Disallow: /g, which blocked all URLs under /g. I modified this to Allow: /g/Sitetor and Disallow: /g/* to allow indexing of the specific page while blocking others in that directory.

However, even after these changes and submitting the URL in Google Search Console, the page is still not being indexed. I’ve re-checked the robots.txt with Google’s robots.txt tester, and it seems to be configured correctly.

I’m stumped! Could there be another reason why Google is seeing a “noindex” directive? Any help would be greatly appreciated.

Thanks in advance!

A alert window on a computer screen with Korean text indicating that the URL entered is inactive or invalid. (Captioned by AI)
A alert window on a computer screen with Korean text indicating that the URL entered is inactive or invalid. (Captioned by AI)2026×946 71.4 KB

4

I think disallow overrides allow.

5

Why only some of the pages (one example) are facing No: 'noindex' detected in 'X-Robots-Tag' http header error by Google Search Console?

If my search/index settings would prohitbit google bot, then they should get ‘No Access’ error on all pages. Why only some of the pages are returning the above error?