# Block crawlers from embedded topics only?

**URL:** <https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916>\
**Category:** Product Support\
**Created:** [June 19, 2023, 3:34pm UTC](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916 "2023-06-19T15:34:53Z")\
**Posts on this page:** 1\
**Showing post:** 9

<div class="post-metadata">

**Author:** ![haydenjames](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/haydenjames/32/255678_2.png) [@haydenjames](https://meta.discourse.org/u/haydenjames)\
**Post date:** [June 19, 2023, 6:28pm UTC](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916/9 "2023-06-19T18:28:05Z")

</div>

> [@angus](#):
>
> I don’t think (but happy to be corrected) that what you want to do is a current Discourse feature. Discourse currently adds a `X-Robots-Tag: noindex` header to GET requests for hidden topics. You could do the same for embedded topics via a plugin.

Thanks @angus

To clarify, if I make the category that stores the WP-discourse connected post hidden (is hidden different to private?) then it will hide the post from the forums/public/crawlers but the inserted comments at the end of each Wordpress blog post with comments will still be visible?

Sorry about the noob questions, I’m not experienced with Discourse and want to make sure I’m not misinterpreting your response.

---

_[View the full topic](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916)._