# Negative SEO because of too much category pages getting indexed

**URL:** https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420
**Category:** Support
**Created:** [6월 30, 2017, 7:58오후 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420 "2017-06-30T19:58:35Z")
**Posts on this page:** 10
**Page:** 1

<div class="post-metadata">

### Author: ![veer](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/veer/32/69391_2.png) [@veer](https://meta.discourse.org/u/veer)
#### Post date: [6월 30, 2017, 7:58오후 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/1 "2017-06-30T19:58:35Z")

</div>

If you look for total category pages indexed of [meta.discourse.org](http://meta.discourse.org) with following query in google

`site:meta.discourse.org/c/`

you will find 1670 pages index. Similarly i have a discourse site with 50 categories  
while here more than 23 thousand pages are indexed under category. ( **A very very dangerous signal for seo because of content duplicacy** )  
It should be fixed otherwise google will penalise a discourse website rankings.  
Look at the following screenshot how duplicate pages are created and indexed.

 ![](https://global.discourse-cdn.com/meta/original/3X/0/a/0a9c740a1721b0209b08ea91456f6699e435aa95.png)

---

<div class="post-metadata">

### Author: ![Stranik](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/stranik/32/85638_2.png) [@Stranik](https://meta.discourse.org/u/Stranik)
#### Post date: [6월 30, 2017, 8:08오후 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/2 "2017-06-30T20:08:48Z")

</div>

I tried to write about this earlier. This is an example:  
[https://meta.discourse.org/t/seo-for-discourse-not-working-properly/60709/5?u=stranik](https://meta.discourse.org/t/seo-for-discourse-not-working-properly/60709/5)

Possible

```
Disallow: /latest?exclude_*
Disallow: /*?no_subcategories=*

```

I think it is more correct to look directly into the search index. I don’t know if there is such a mechanism in the Google search engine. In Yandex there is a detailed report: duplicates, poor content, all types of errors, are excluded and the included page, graphics crawls, etc. According to the results, a lot of duplicate pages.

---

<div class="post-metadata">

### Author: ![Mittineague](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mittineague/32/114259_2.png) [@Mittineague](https://meta.discourse.org/u/Mittineague)
#### Post date: [6월 30, 2017, 8:54오후 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/3 "2017-06-30T20:54:06Z")

</div>

I think you may be expecting the Google search modifier to to behave in a way it doesn’t.

[Refine Google searches - Google Search Help](https://support.google.com/websearch/answer/2466433)

> Search for a specific site  
> Put “site:” in front of a site or domain. For example, site:youtube.com or site:.gov.

Do you have a Google reference that indicates URLs with sub-folders limits results to only those folders?

---

<div class="post-metadata">

### Author: ![veer](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/veer/32/69391_2.png) [@veer](https://meta.discourse.org/u/veer)
#### Post date: [6월 30, 2017, 10:00오후 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/4 "2017-06-30T22:00:32Z")

</div>

see snapshot. same cat pages indexed multiple times.

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [6월 30, 2017, 10:34오후 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/5 "2017-06-30T22:34:11Z")

</div>

The issue is these weirdo querystrings.. where is this crap coming from?

 ![](https://global.discourse-cdn.com/meta/original/3X/3/3/3333c55b0fa3f97839b1f39ebfeae19b5e7784c2.png)

`page` I can certainly understand, but…

`no_subcategories`?  
`slow_platfom`?  
`per_page`?

wtf?

Just combining those three plus `page`, that’s

16 categories \* 4 \* 3 \* 2 = 384

384 category “pages”

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [6월 30, 2017, 10:39오후 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/6 "2017-06-30T22:39:33Z")

</div>

I think I see the problem, and we need to fix it ASAP

`https://meta.discourse.org/c/plugin?no_subcategories=false&page=2&slow_platform=20`

This page _must_ have a canonical meta-tag like so:

`<link rel="canonical" href="https://meta.discourse.org/c/plugin?page=2" />`

Can you take this @techapj please? the meta-tag should be served to all clients including Google crawler.

---

<div class="post-metadata">

### Author: ![techAPJ](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/techapj/32/342990_2.png) [@techAPJ](https://meta.discourse.org/u/techAPJ)
#### Post date: [7월 3, 2017, 8:44오전 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/7 "2017-07-03T08:44:35Z")

</div>

We used to include canonical meta tag on `/c/plugin ` page but (I think) this was regressed 4 months ago when we introduced “Default Topic List” category setting.

This should now be fixed, and a test case is added to prevent future regression.

[https://github.com/discourse/discourse/commit/72c92b0f4e2c324a9902613c9464fc45bf7fc09b](https://github.com/discourse/discourse/commit/72c92b0f4e2c324a9902613c9464fc45bf7fc09b)

Now all the category pages should have canonical meta tag except the Top category page (`/c/plugin/l/top`).

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [7월 3, 2017, 9:07오전 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/8 "2017-07-03T09:07:47Z")

</div>

We should probably backport this fix..

---

<div class="post-metadata">

### Author: ![techAPJ](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/techapj/32/342990_2.png) [@techAPJ](https://meta.discourse.org/u/techAPJ)
#### Post date: [7월 3, 2017, 9:18오전 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/9 "2017-07-03T09:18:50Z")

</div>

Okay, backported this fix to `beta` and `stable` branch.

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [7월 5, 2017, 1:00오전 UTC](https://meta.discourse.org/t/negative-seo-because-of-too-much-category-pages-getting-indexed/65420/10 "2017-07-05T01:00:08Z")

</div>

This topic was automatically closed after 28 hours. New replies are no longer allowed.
