Hi all, may seem like a really stupid question, but I’ve setup a discourse forum with ‘login required’ checked. I’m assuming that google and other crawlers will never get to see it’s content. I don’t really want tom dick and harry having access to freely read the forum, but am interested in knowing if there is a way to enable search engines to index it? (yes, I know the information will be exposed in google searches… but that’s kind of the idea - to encourage people who are really interested to sign up…). br, Simon p.s. a plugin which supports something like this may be good: https://webmasters.googleblog.com/2008/10/first-click-free-for-web-search.html i.e. allowing viewing of posts when referred by google, but requesting login if navigating direct? p.p.s - now with the correct search terms, I see this has already been discussed: [image] Let googlebot see content, but make users log in Feature I want to require my users to login to view topics, but I assume that makes all content invisible to Google? Ideally the topics/posts would still be indexed by Google for their SEO value to help drive traffic, and then when a user clicks a result they would be taken to the front page where I can tell them why they should sign up. Some more technical users will probably be able to spoof the googlebot useragent and get access to the content that way, but I’m sure that is a small percentage. Any … A little sad about the negativity - in our case the forum is in support of a product website, which is free to sign up, and only costs if you use the product (pay per use). I guess when we’re more confident about what the forum will contain, or if we get time to moderate correctly, the forum should be publicly readable.

I guess for us it’s more about not having run a forum before, and being concerned about what may be written - but that’s what moderation is for. We’ll just have to make it publicly readable once we have a little experience.

Mostly you want people to be able to see your stuff. You probably won’t have people saying bad stuff unless you have problems with your product. If you have problems with your product you want to know that so that you can fix them. Having problems that you fix makes you look good, not bad.

Enabling google/other to crawl a 'login required' forum

Product Support

Dannii (Dannii) August 8, 2019, 8:06am 2

This is an obnoxious practice.

Topic		Replies	Views
Allow crawlers to scrape and index forum but only allow access via login? Product Support	1	452	May 3, 2021
Can search engines crawl, if forum behind single sign on Product Support	2	923	November 19, 2017
Option to index topics Product Support	7	745	December 31, 2022
How to enable search engine indexing? Product Support	5	454	November 25, 2023
Let googlebot see content, but make users log in Feature	10	7245	May 24, 2014

Enabling google/other to crawl a 'login required' forum

Related topics