我们的域名的SEO正在受到影响

[Firepup650 (Firepup Sixfifty)]

@tomg

27 个页面被阻止抓取，即：Profile - Lendemor - Reflex

据我所知，个人资料页面是故意阻止被索引的：

How to edit robot.txt for indexing user profiles?

User profiles are disallowed as the version which is seen by the crawler contains no useful information. It’s not a question of whether the server can handle it or “take the hit”, it’s the tens of thousands of effectively empty pages which will waste the crawl time allocated to your site by the search engines.

Applying Schema.org on the user profile page for improved author authority on Google

The tricky thing though is that we don’t even allow indexing on user pages. [image] Generally we see them as low value pages to add to Google. Stack Overflow and a few other places do allow indexing here. I guess a lot is depending on our strategy around user pages, they are very possibly a spam and abuse vector with mixed in privacy concerns. Potentially if we only allowed indexing to particular groups and we had an HTML view that was better than just a blank page with a user name. Then t…