# Let googlebot see content, but make users log in

**URL:** <https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724>\
**Category:** Feature\
**Created:** [2014年三月14日 07:42 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724 "2014-03-14T07:42:56Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![jorgtron](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/jorgtron/32/114269_2.png) [@jorgtron](https://meta.discourse.org/u/jorgtron)\
**Post date:** [2014年三月14日 07:42 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/1 "2014-03-14T07:42:57Z")

</div>

I want to require my users to login to view topics, but I assume that makes all content invisible to Google? Ideally the topics/posts would still be indexed by Google for their SEO value to help drive traffic, and then when a user clicks a result they would be taken to the front page where I can tell them why they should sign up.

Some more technical users will probably be able to spoof the googlebot useragent and get access to the content that way, but I’m sure that is a small percentage.

Any ideas on how I could implement this?

Thanks!

---

<div class="post-metadata">

**Author:** ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)\
**Post date:** [2014年三月14日 15:50 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/2 "2014-03-14T15:50:31Z")

</div>

This is not something that Google allows. If Google can index it, the assumption is that users can get to it by clicking through.

What you propose would get you delisted from Google.

---

<div class="post-metadata">

**Author:** ![michaeld](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/michaeld/32/1594_2.png) [@michaeld](https://meta.discourse.org/u/michaeld)\
**Post date:** [2014年三月14日 18:49 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/3 "2014-03-14T18:49:03Z")

</div>

That’s what Quora does all the time.

But there’s also the First Click Free program, I think having support for this in Discourse would be a great idea.  
Although I think that [the proposed Referer: check](http://googlewebmastercentral.blogspot.nl/2008/10/first-click-free-for-web-search.html) is impossible in 2014 since Google uses https.

> **[Publisher Center Help](https://support.google.com/news/publisher-center/?visit_id=639159003214256898-975524900&hl=en&rd=4#topic=9603441)**
>
> Official Google News Publisher Center Help Center where you can find tips and tutorials on using Google News Publisher Center and other answers to frequently asked questions.

> First Click Free

> If you offer subscription-based access to your website content, or if users must register to access your content, then search engines cannot access some of your site’s most relevant, valuable content.

> Implementing Google’s First Click Free (FCF) for your content allows you to include your restricted content in Google’s main search index. Our intention is to protect your content while allowing for its inclusion in Google’s search index. First Click Free has two main goals:

> ```
> To include high-quality content in Google's search index, providing a better experience for Google users who may not have known that content existed.
> To provide a promotion and discovery opportunity for webmasters of sites with restricted content.
> 
> ```

> To implement First Click Free, you need to allow all users who find a document on your site via Google search to see the full text of that document, even if they have not registered or subscribed to see that content. The user’s first click to your content area is free. However, once that user clicks a link on the original page, you can require them to sign in or register to read further. The user must be able to see the full content of a multi-page article. You can allow this by displaying all content on a single page to both Googlebot and users. Alternatively, you can use cookies to make sure that a user can visit each page of a multi-page article before being asked for registration or payment.

> In order to successfully crawl your site, Google needs to be able to crawl your content without filling out a registration form. The easiest way to do this is to configure your webservers not to serve the registration page to our crawlers (when the user-agent is “Googlebot”) so that Googlebot can crawl these pages successfully. You can choose to allow Googlebot access to some restricted pages but not others. More information about technical requirements.

---

<div class="post-metadata">

**Author:** ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)\
**Post date:** [2014年三月14日 19:02 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/4 "2014-03-14T19:02:40Z")

</div>

Oh yeah, thanks, I was going to mention that program but couldn’t remember the right search keywords (irony?).

If you want to force a login dialog popup on arrival of all new users, that’s a different thing. Provided it is dismissable that could meet the Google guidelines – no different than any other popup you would show users on arrival (ads, etc).

---

<div class="post-metadata">

**Author:** ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)\
**Post date:** [2014年三月15日 01:08 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/5 "2014-03-15T01:08:41Z")

</div>

This is what Quora does. I would emulate this at your own risk…

 ![](https://global.discourse-cdn.com/meta/original/2X/d/d893eae0c175afdf0b3bbdd5431b3c1638a6371c.png)

---

<div class="post-metadata">

**Author:** ![awesomerobot](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/awesomerobot/32/142900_2.png) [@awesomerobot](https://meta.discourse.org/u/awesomerobot)\
**Post date:** [2014年三月15日 01:40 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/6 "2014-03-15T01:40:38Z")

</div>

It’s also the most annoying sleazy douchebaggiest behavior and everyone will hate you if you do what Quora does, whether or not Google delists you.

---

<div class="post-metadata">

**Author:** ![BhaelOchon](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/bhaelochon/32/191311_2.png) [@BhaelOchon](https://meta.discourse.org/u/BhaelOchon)\
**Post date:** [2014年三月15日 02:08 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/7 "2014-03-15T02:08:51Z")

</div>

Also, anyone with knowledge of browser dev tools can easily bypass it.

---

<div class="post-metadata">

**Author:** ![BCHK](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/bchk/32/3268_2.png) [@BCHK](https://meta.discourse.org/u/BCHK)\
**Post date:** [2014年三月15日 06:11 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/8 "2014-03-15T06:11:17Z")

</div>

Isn’t this what the NY Times does also? (or something similar)…

---

<div class="post-metadata">

**Author:** ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)\
**Post date:** [2014年三月15日 06:22 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/9 "2014-03-15T06:22:12Z")

</div>

No, that is a paywall.

> **[Paywall](https://en.wikipedia.org/wiki/Paywall)**
>
> A paywall is a method of restricting access to content, with a purchase or a paid subscription, especially news. Beginning in the mid-2010s, newspapers started implementing paywalls on their websites as a way to increase revenue after years of decline in paid print readership and advertising revenue, partly due to the use of ad blockers. In academics, research papers are often subject to a paywall and are available via academic libraries that subscribe.
> Paywalls have also been used as a way of...

---

<div class="post-metadata">

**Author:** ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)\
**Post date:** [2014年三月15日 07:03 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/10 "2014-03-15T07:03:37Z")

</div>

I would object quite violently to a quora like feature in core, its not behavior I would like to see emulated, build a plugin

---

<div class="post-metadata">

**Author:** ![Mittineague](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mittineague/32/114259_2.png) [@Mittineague](https://meta.discourse.org/u/Mittineague)\
**Post date:** [2014年五月24日 01:16 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/11 "2014-05-24T01:16:24Z")

</div>

Yes, please DO NOT.

Turning off CSS shows the content and the first time I went to quora was also my last.

---

<div class="post-metadata">

**Author:** ![chapoi](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/chapoi/32/537252_2.png) [@chapoi](https://meta.discourse.org/u/chapoi)\
**Post date:** [2025年十二月4日 11:09 UTC](https://meta.discourse.org/t/let-googlebot-see-content-but-make-users-log-in/13724/12 "2025-12-04T11:09:28Z")

</div>


