A Google search result for a specific post on a Discourse forum is linking to the wrong page. Quintin_Par searched for a quoted paragraph and the result linked to a different post than the intended one. The issue seems to be related to how Google indexes the forum pages.
codinghorror pointed out that the canonical link on the page is set to https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157?page=2, which is not the correct page for the searched post.
gerhard analyzed the issue and found that the problem is due to the fact that Google is indexing the wrong page. The search term is present in post 12, which belongs to page 1, but the link provided by Google points to page 2.
sam explained that the issue is fundamental and that the current implementation of canonical links is not suitable for this scenario. He suggested that one possible solution could be to tell Google not to index “post” links and instead crawl the canonical link.
Additionally, sam found other broken links on the meta.discourse.org site that need to be investigated. The issue seems to be related to how the site map plugin and the logic for presenting content to Google are implemented.
I did a search for this topic, which is a comment on CodingHorror’s March 2017 post
The first link Google points to, is the blogpost and the second one to the forum/comment discussion/post.
something about the google indexing here is weird. the canonical on that page is:
<link rel="canonical" href="https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157?page=2">
so I am not even sure how that is showing up there.
My google results from your link are in this order
https://blog.codinghorror.com/thunderbolting-your-video-card/https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157/9https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157/21https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157The actual correct result would be post number 12…
https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157/12
… so 9 and 21 are a bit off but certainly “on the same page” ish.
Still it is odd to search for a whole quoted paragraph plus, verbatim. in Google.
For your specific case I wonder if canonical should be the parent blog at least for all the comments that render on parent blog.
I also wonder about adding an option to redirect crawlers to the correct page vs canonical.
For a 100% embedded case you want the search to always hit the parent blog except for super rare cases
The actual search in this case is a bit bizarre so I am not cnfortable basing an entire philosophy on a sample size of one.
I saw this bug on another forum and wanted an example to showcase, hence the search by a paragraph.
Please don’t change the current functionality to a blogpost canonical. Here’s the reason:
For the record, this is how the search results look for me right now:
https://blog.codinghorror.com/thunderbolting-your-video-card/
https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157?page=2
The strange thing is that the search term isn’t present on page 2. It’s found in post 12 which belongs to page 1. So, when you land on page 2 which translates to posts 20 and onwards, you don’t find what you were looking for. That’s quite confusing for users.
And I think Google gets confused too because the blog post links to post 31 via the 
link.
When you visit https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157/31 as Google Bot you land on a page that contains post 11 up to post 31. And the canonical wrongfully points to https://discourse.codinghorror.com/t/thunderbolting-your-video-card/5157?page=2.
I think the correct fix is to show the search bot the full page that includes the linked post. For post 31 that would be page 2 starting at post 21 and ending at max 40.
Might this involve the discrepancy between visible and deleted posts count? i.e. deleted posts still retain their post id value.
Não, isso não tem nada a ver com posts excluídos. Considero isso um Contribute > Bug.
Ele simplesmente não usa o deslocamento (offset) correto do post. A visualização para crawlers exibe os posts em páginas. Posts 1-20, 21-40, … Se um crawler solicitar um número de post específico, o aplicativo deve renderizar a página correta. Para o post 31, é necessário selecionar a página 2 e renderizar os posts de 21 a 40. Qualquer outra coisa resulta em um índice de pesquisa incorreto.
This is the fundamental issue… we have no “correct” canonical page if we are displaying content from 2 different pages on the screen. Only way to correct this is making pages for “crawling” purpose work differently and this enters other worlds of pain.
For my blog what I do is just keep the whole chunk of comments with the blog post, eg:
But the issue described here is far more fundemental we give web crawlers a bunch of content splayed across 2 pages and then we just pick the canonical for one of the posts in the set.
One way I can think of ways of resolving this, tell google not to index “post” links eg: https://meta.discourse.org/t/google-indexed-link-not-pointing-to-the-correct-post/61443/9 is a post link, using meta tags which may force its hand to crawl the canonical and index that instead, it may work. I don’t know. Very trick problem.
Interestingly there is a far more severe issue I am noticing when I search
google indexing site:meta.discourse.org
I find these 2 broken links that we need to figure out how this even happened:
This on the second page:
https://meta.discourse.org/t/google-complaining-indexed-though-blocked-by-robots-txt/96408?page=2
This on the third
https://meta.discourse.org/t/canonical-tag-generated-with-page-2/32842?page=4
It is not really making sense how this sneaked in. My first port of call here would be to check the site map plugin to confirm it does not include these bad links AND then to confirm there is no logic where we are presenting google with content on these pages instead of an error page.