Google Search Console started sending me error reports about some Discourse pages. URL is on Google, but has issues It can appear in Google Search results (if not subject to a manual action or removal request). However, some issues prevent it from being eligible for all enhancements. [Learn more …

This one is odd @codinghorror we saw the same thing with Bing on the user pages, should we just add that magic noindex meta tag here to double ensure user pages do not sneak in to indexes?

Or we could put useful content on the search engine / text browser view of user pages, like links to your top replies and top topics :slight_smile:

hmmm … no… we purposely do not want to index user pages. besides the spam factor what kind of value does this provide.

People on here keep asking for MORE SEO JUICE and INTERLINKING every so often and I honestly can’t think of anything better along those lines than linking to the most-liked posts + recent posts you’ve made. Also, a forum user page is a valid search result for someone who wants to see your recent po…

We did the “please index the user page” conversation so many times though… in fact, to be honest, I think even mentioning this automatically raises the blood temperature in Jeff’s head automatically by 10 degrees. Let’s keep this focused on just properly excluding the user page so we can stop deali…

Hmm we could make it so TL2 and higher get indexed user pages @sam . That would be consistent with nofollow rules in posts too.

[image] sam: mentioning this automatically raises the blood temperature in Jeff’s head automatically by 10 degrees. It raised mine by more than a few mm Hg As someone that has been a moderator for several years and seen countless examples of what I call “profile spam” I beg, please no. To t…

I do like the idea of allowing this to TL2, agree it is consistent with the nofollow stuff.

If you are adding the per-page tag it is almost the same code anyway, and we’d need to remove the robots.txt user path block anyhow.

Google complaining – Indexed, though blocked by robots.txt

Support

codinghorror (Jeff Atwood) September 6, 2018, 3:26am 3

I guess, if it gets people to stop bugging us about it. It makes no difference in practice other than reducing the nagging.

Topic		Replies	Views
Why there are lots of Disallow rule in robots.txt? Support	34	4932	December 22, 2020
Issues Google Search Console is throwing at me for wrong discourse structure (or some for wrong administration of my site) Support	18	384	December 18, 2024
Pages listed in the robots.txt are crawled and indexed by Google Support	18	3539	July 30, 2019
Why isn't Google Indexing Discourse? SEO concerns Support seo	31	6300	June 1, 2024
Google indexing issue (robots.txt) Support	7	821	April 18, 2020

Google complaining – Indexed, though blocked by robots.txt

Related topics