# SEO for /groups and similar

**URL:** https://meta.discourse.org/t/seo-for-groups-and-similar/116018
**Category:** Feature
**Created:** [4월 25, 2019, 10:36오후 UTC](https://meta.discourse.org/t/seo-for-groups-and-similar/116018 "2019-04-25T22:36:56Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![Krischan](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/krischan/32/47290_2.png) [@Krischan](https://meta.discourse.org/u/Krischan)
#### Post date: [4월 25, 2019, 10:36오후 UTC](https://meta.discourse.org/t/seo-for-groups-and-similar/116018/1 "2019-04-25T22:36:56Z")

</div>

The more /groups and similar pages (enhanced by themes) move from admin / purely functional views to meaningful landing pages, the more it makes sense to include them in robot.txt and optimize them for search.

---

<div class="post-metadata">

### Author: ![Stephen](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/stephen/32/95011_2.png) [@Stephen](https://meta.discourse.org/u/Stephen)
#### Post date: [4월 25, 2019, 10:56오후 UTC](https://meta.discourse.org/t/seo-for-groups-and-similar/116018/2 "2019-04-25T22:56:30Z")

</div>

What benefit does crawling /groups offer?

They don’t hold any unique information, all of the topics in group activity are already going to be crawled.

With crawlers dedicating finite resources to each site, doesn’t crawling pages which only link to pages linked elsewhere reduce the effectiveness of each crawl?

---

<div class="post-metadata">

### Author: ![Krischan](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/krischan/32/47290_2.png) [@Krischan](https://meta.discourse.org/u/Krischan)
#### Post date: [4월 25, 2019, 11:15오후 UTC](https://meta.discourse.org/t/seo-for-groups-and-similar/116018/3 "2019-04-25T23:15:27Z")

</div>

If the main value of your community is your content, I’d say that’s totally correct. But if the value also come from the groups, categories etc. you offer, I would like to have unique information for these pages so they get valuable for the crawler.

---

<div class="post-metadata">

### Author: ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)
#### Post date: [4월 29, 2019, 2:45오전 UTC](https://meta.discourse.org/t/seo-for-groups-and-similar/116018/4 "2019-04-29T02:45:39Z")

</div>

I think it is reasonable to have `https://meta.discourse.org/g` in robots, maybe even `https://meta.discourse.org/g/encrypt-users` @codinghorror what are your thoughts here?
