I want Google to index the content in the link format domain/u/username, what should I do? I have removed the Disallow: /u part to let the link format domain.com/u be indexed by Google, but what should I do if I want the slug format domain/u/username to be indexed by Google? Is there any other conf…

Hello :waving_hand: Is this site setting enabled on your site? hide user profiles from public If yes, than disable it and you’ll be able to access user profiles without login too.

Are you sure your users are equally happy that you would like to tell whole wide world about their membership and some other stuff?

but I still can’t submit the link in the form of domain/u/username to index with Google, what else do I need to open? (I have attached the image for you to see the status) [image]

If I remember right that limit comes a bit deeper than robots.txt. Sure, it is quite fast test allowing /u in robots.txt. But if it comes deeper from the core you may need a plugin. Dig here. That was a thing perhaps a year ago, came along with SEO-stuff, and there was strong reason why it is not a…

I put it in robots.txt (attached image) but it didn’t work, so I came here to ask you. [image]

Does “View live test” give you any more information?

It’s probably because user profiles send this HTTP header: x-robots-tag: noindex You can see it if you run this command in a terminal, replacing <url> with the URL of a user profile: curl -sSL -D - -o /dev/null <url> If you remove the robots.txt rule, Google will see that header and deindex the…

I know the url is Noindex but I don’t know where to edit it in the source discourse. In the robots.txt file, the Disallow: /u part has been removed. I have attached a photo. [image]

Help me index slug into username of source code? I want to open index for this slug domain like this example: https://domain.com/u/toannguyen/activity (example link), what do I need to do in the discourse source code? Currently, when I submit this type of link in Google Search Console, it says it …

I want Google to index the content in the link format domain/u/username, what should I do?

Product Support

toanvoc (Toan Nguyen) August 7, 2024, 5:46am 4

Thanks a lot!

Topic		Replies	Views
Indexing User Profiles Product Support	2	177	September 4, 2025
Excluding user profiles in robots.txt (or allow edit of file) Feature	4	2627	May 24, 2014
Why there are lots of Disallow rule in robots.txt? Product Support	34	4981	December 22, 2020
How to edit robot.txt for indexing user profiles? Product Support	7	1161	April 5, 2023
Google complaining – Indexed, though blocked by robots.txt Product Support	22	2824	December 13, 2019

I want Google to index the content in the link format domain/u/username, what should I do?

Related topics