Hello everyone. I ran into a problem. When my posts from a Wordpress blog are imported to Discourse, they are visible to search robots. My posts are imported into the “News” category I was thinking about adding the “News” category to the file robots.txt, but the category url does not spell out the word “News” For example: URL category “News”: https://example.com/c/news/5 URL post in category "News: https://example.com/t/conditional-formatting/244 I’m thinking to add a category to robots.txt, but the URL should look like this: https://example.com/news/conditional-formatting/244 Please tell me how I can do this? Perhaps there are other options to hide posts from WP Discourse from indexing. Any ideas? Please help to solve this problem

There is nothing to solve out. It is not affecting your SEO anyway because of canonical URLs. It is actually someway improving your SEO (if users are commenting or reacting, and if Google thinks so).

Posts in WP Discourse interferes with the SEO of the Wordpress site

Product Support WordPress

Mikhail_Tyuftyaev (Mikhail Tyuftyaev) November 24, 2021, 8:16am 3

@Jagster Thank you very much for your reply.
I didn’t even know what canonical links were. It’s good that Discourse can do this

Topic		Replies	Views
Block crawlers from embedded topics only? Product Support	17	1021	June 20, 2023
Need a way to add "meta robots noindex" in topics from a category Feature seo	6	1426	February 12, 2025
Old topics published via WordPress embed are missing x-robots: noindex and canonical tags WordPress wordpress	10	722	August 15, 2026
How to add noindex to an entire category? Product Support	12	2663	September 24, 2017
Discourse SEO overview (sitemap / robots.txt) Site Management seo , explanation	0	2670	October 18, 2023

Posts in WP Discourse interferes with the SEO of the Wordpress site

Related topics