The query displays a total of 887,652 records in discourse. [101010] When I view a sitemap XML file in the browser, it displays ten files. Each file contains 50,000 records, but the complete set of records is not visible. You can refer to the previous screenshot for the total count of “887,652” r…

I have over 800000 topics on my wbsite but sitemap only including upto approx 500000 records. Is there any specific configuration needed?

I’ve slipped your post over to this topic @Ashwani_Kumar as they ask a very similar question and you should be able to benefit from the same answers. :+1:

The XML sitemaps that Discourse is generating isn’t including all posts on my site. I did a query for posts and I see around 800k posts. But the XML sitemaps only include 347k. I’m missing about 55% of post URLs in the sitemap.

I’ve moved your topic over as well @Marc_S as it sounds like a very similar question.

Also, the query in the OP would pull out all the PMs and deleted topics as well. I think it would need to be more like: SELECT COUNT(*) FROM topics t JOIN categories c ON c.id = t.category_id WHERE c.read_restricted IS FALSE AND t.archetype = 'regular' AND t.deleted_at IS NULL

Nice work! I bet deleted posts and PMs explains the missing topics.

@JammyDodger Thanks for providing the above query. So that means that Topic having type “Private Messages” would not included in the sitemap xml Right?

That’s correct, even if they were in the sitemap, Google wouldn’t be able to access them.

Sitemap XML file can not show full topic and posts

Support

pfaffman (Jay Pfaffman) January 13, 2024, 12:37pm 8

Are the missing topics in private categories?

Topic		Replies	Views
?page= bug, both in core and in sitemap plugin Bug sitemap	3	683	May 27, 2021
Sitemap plugin - no ?page=… urls in default sitemap Bug sitemap	12	1461	October 18, 2023
Google Webmaster Can't read sitemap Support sitemap	5	1432	February 27, 2024
Sitemap issue Support sitemap	18	635	July 25, 2024
How to use the sitemap properly? Support sitemap	19	728	August 15, 2024

Sitemap XML file can not show full topic and posts

Related topics