קידום אתרים לדומיין שלנו מושפע

[Firepup650 (Firepup Sixfifty)]

@tomg

27 pages blocked from crawling, i.e.: Profile - Lendemor - Reflex

AFAIK, profile pages are intentionally blocked from being indexed:

How to edit robot.txt for indexing user profiles?

User profiles are disallowed as the version which is seen by the crawler contains no useful information. It’s not a question of whether the server can handle it or “take the hit”, it’s the tens of thousands of effectively empty pages which will waste the crawl time allocated to your site by the search engines.

Applying Schema.org on the user profile page for improved author authority on Google

The tricky thing though is that we don’t even allow indexing on user pages. [image] Generally we see them as low value pages to add to Google. Stack Overflow and a few other places do allow indexing here. I guess a lot is depending on our strategy around user pages, they are very possibly a spam and abuse vector with mixed in privacy concerns. Potentially if we only allowed indexing to particular groups and we had an HTML view that was better than just a blank page with a user name. Then t…