# Block crawlers from embedded topics only?

**URL:** <https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916>\
**Category:** Product Support\
**Created:** [June 19, 2023, 3:34pm UTC](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916 "2023-06-19T15:34:53Z")\
**Posts on this page:** 1\
**Showing post:** 12

<div class="post-metadata">

**Author:** ![haydenjames](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/haydenjames/32/255678_2.png) [@haydenjames](https://meta.discourse.org/u/haydenjames)\
**Post date:** [June 19, 2023, 6:45pm UTC](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916/12 "2023-06-19T18:45:48Z")

</div>

This is cool. Thanks for clarifying and sharing the [WP Discourse](https://github.com/discourse/wp-discourse) setting.

Question: If I manually edit my Discourse robots.txt file. Will the change remain persistent?

I’m still in the process of searching the forums for that answer. Will insert any links I find that answers that.

---

_[View the full topic](https://meta.discourse.org/t/block-crawlers-from-embedded-topics-only/268916)._