# Block crawlers from embedded topics only?

**URL:** <https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916>\
**Category:** Product Support\
**Created:** [June 19, 2023, 3:34pm UTC](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916 "2023-06-19T15:34:53Z")\
**Posts on this page:** 1\
**Showing post:** 1

<div class="post-metadata">

**Author:** ![haydenjames](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/haydenjames/32/255678_2.png) [@haydenjames](https://meta.discourse.org/u/haydenjames)\
**Post date:** [June 19, 2023, 3:34pm UTC](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916/1 "2023-06-19T15:34:53Z")

</div>

Other than manually, is it possible to set up robots.txt to block all WP-Discouse-connected forum threads?  
(so that the forum post isn’t indexed)

A simple toggle option that can block all connected forum threads from crawling? Or even a per-post toggle setting when publishing or editing a WP post that is linked to wp-discourse forum thread?

---

_[View the full topic](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916)._