The number of pages indexed by Google is decreasing

AI-generated summary

Muhammed_EKİCİ reports a steady decline in the number of pages indexed by Google in Search Console, despite having an active forum with 100% original user-generated content and a DAU/MAU ratio of 38%. He is using Discourse v3.2.0.beta4-dev and seeks advice on the cause. jericson suggests checking the “Pages” page in Search Console for specific reasons why pages aren’t indexed — such as “Crawled - currently not indexed” or “Discovered - currently not indexed” — which can be manually requested for indexing. He notes that while reindexing may feel like an “illusion of control” (like pressing the “close door” button in an elevator), it’s harmless if already reviewing reports. He also warns that server errors (5xx) or 404s may indicate site downtime and should be fixed. Wojtek_X speculates there might be a background cronjob affecting indexing behavior. The consensus leans toward Google’s indexing delays being normal, unless a technical issue on the site is identified.

Recently, I see that the number of pages indexed in the Google Developer Console is decreasing day by day.

The content created on the forum is created entirely by real users and is 100% original. In the Discourse admin panel, I see that the DAU/MAU ratio is 38%. So I have a very active forum. Does anyone have an idea what the decrease in indexed pages might be? I am using the latest version discourse (3.2.0.beta4-dev)

1 Like

If you got down to the “Pages” page, it should have a list of reasons for why pages aren’t indexed. Some reasons (“Page with redirect”, “Excluded by ‘noindex’ tag”, “Alternate page with proper canonical tag”, etc.) aren’t really worth worrying about. But “Crawled - currently not indexed” and “Discovered - currently not indexed” can be scheduled for indexing. I think it’s just Google taking its time indexing stuff. “Server error (5xx)” and “Not found (404)” are usually the result of site downtime and those can be reindexed too.

From a return on investment standpoint, I’m not sure how much is pays to request indexing. Probably doesn’t hurt to do it if you are already looking at the reports. It just feels like pressing the “close door” button in an elevator. Seems as likely as not to be an illusion of control :wink:

The exception, of course, is it the reasons for not indexing a page can be traced back to a problem on your site. In my experience, Google does a good job explaining the problem if it spots one.

There must be kind-of cronjob set somewhere BTS.