# Temporarily block Google crawler while setting up live site?

**URL:** https://meta.discourse.org/t/temporarily-block-google-crawler-while-setting-up-live-site/137847
**Category:** Support
**Created:** [January 6, 2020, 6:39am UTC](https://meta.discourse.org/t/temporarily-block-google-crawler-while-setting-up-live-site/137847 "2020-01-06T06:39:40Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![donovan](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/donovan/32/165537_2.png) [@donovan](https://meta.discourse.org/u/donovan)
#### Post date: [January 6, 2020, 6:39am UTC](https://meta.discourse.org/t/temporarily-block-google-crawler-while-setting-up-live-site/137847/1 "2020-01-06T06:39:40Z")

</div>

I’m sure there’s a setting for this somewhere but can’t find it.

Still implementing redirects from the old forum to Discourse. Is there a way to temporarily block crawling by Google to avoid duplicate content?

---

<div class="post-metadata">

### Author: ![JimPas](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/jimpas/32/148179_2.png) [@JimPas](https://meta.discourse.org/u/JimPas)
#### Post date: [January 6, 2020, 6:59am UTC](https://meta.discourse.org/t/temporarily-block-google-crawler-while-setting-up-live-site/137847/2 "2020-01-06T06:59:14Z")

</div>

You can set your site to “Login Required” in Admin/Settings/Login and check the box for login required.

---

<div class="post-metadata">

### Author: ![donovan](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/donovan/32/165537_2.png) [@donovan](https://meta.discourse.org/u/donovan)
#### Post date: [January 6, 2020, 7:10am UTC](https://meta.discourse.org/t/temporarily-block-google-crawler-while-setting-up-live-site/137847/3 "2020-01-06T07:10:01Z")

</div>

Does that block crawlers as well?

---

<div class="post-metadata">

### Author: ![JimPas](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/jimpas/32/148179_2.png) [@JimPas](https://meta.discourse.org/u/JimPas)
#### Post date: [January 6, 2020, 7:33am UTC](https://meta.discourse.org/t/temporarily-block-google-crawler-while-setting-up-live-site/137847/4 "2020-01-06T07:33:30Z")

</div>

Yes, all a crawler will “see” is your homepage, nothing more. Our site is a private, by-invitation-only site with login required. Aside from an occasional hit on the home page, nothing gets indexed because they cannot crawl the site.

---

<div class="post-metadata">

### Author: ![system](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/system/32/443519_2.png) [@system](https://meta.discourse.org/u/system)
#### Post date: [February 5, 2020, 7:33am UTC](https://meta.discourse.org/t/temporarily-block-google-crawler-while-setting-up-live-site/137847/5 "2020-02-05T07:33:37Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
