Excluding user profiles in robots.txt (or allow edit of file)

Good catch. Web crawlers will see almost nothing there. My page as crawlers see it:

Do we even need a setting for this? We could just add a rule to the robots.txt to disallow indexing of user pages. I don’t think any Discourse install would want them to be indexed.

「いいね!」 3