I want Google to index the content in the link format domain/u/username, what should I do? I have removed the Disallow: /u part to let the link format domain.com/u be indexed by Google, but what should I do if I want the slug format domain/u/username to be indexed by Google? Is there any other configuration? I have not logged in and cannot access the slug format: domain/u/username, so I see that it is a problem for Google to index this slug format (attached image). [image] Thank you for supporting me, I am new to source discourse so there are still many things I do not understand. Thanks!

Hello :waving_hand: Is this site setting enabled on your site? hide user profiles from public If yes, than disable it and you’ll be able to access user profiles without login too.

Are you sure your users are equally happy that you would like to tell whole wide world about their membership and some other stuff?

but I still can’t submit the link in the form of domain/u/username to index with Google, what else do I need to open? (I have attached the image for you to see the status) [image]

If I remember right that limit comes a bit deeper than robots.txt. Sure, it is quite fast test allowing /u in robots.txt. But if it comes deeper from the core you may need a plugin. Dig here. That was a thing perhaps a year ago, came along with SEO-stuff, and there was strong reason why it is not allowed.

I put it in robots.txt (attached image) but it didn’t work, so I came here to ask you. [image]

Does “View live test” give you any more information?

It’s probably because user profiles send this HTTP header: x-robots-tag: noindex You can see it if you run this command in a terminal, replacing with the URL of a user profile: curl -sSL -D - -o /dev/null If you remove the robots.txt rule, Google will see that header and deindex the URLs. Google’s documentation: [图片] Robots Meta Tags Specifications | Google Search Central | Documentation | ... Learn how to add robots meta tags and read how page and text-level settings can be used to adjust how Google presents your content in search results.

I know the url is Noindex but I don’t know where to edit it in the source discourse. In the robots.txt file, the Disallow: /u part has been removed. I have attached a photo. [image]

Help me index slug into username of source code? I want to open index for this slug domain like this example: https://domain.com/u/toannguyen/activity (example link), what do I need to do in the discourse source code? Currently, when I submit this type of link in Google Search Console, it says it is blocked from indexing. Hope to get help? Thanks team so much!

我希望Google索引域名/u/用户名格式的链接内容，我应该怎么做？

产品支持

toanvoc (Toan Nguyen) 2024 年9 月 22 日 08:35 13

我需要做什么本地社区发展模型？我已经向我的会员公开了！

话题		回复	浏览量
Indexing User Profiles Product Support	2	196	2025 年9 月 4 日
Excluding user profiles in robots.txt (or allow edit of file) Feature	4	2636	2014 年5 月 24 日
Why there are lots of Disallow rule in robots.txt? Product Support	34	5016	2020 年12 月 22 日
How to edit robot.txt for indexing user profiles? Product Support	7	1177	2023 年4 月 5 日
Google complaining – Indexed, though blocked by robots.txt Product Support	22	2845	2019 年12 月 13 日

我希望Google索引域名/u/用户名格式的链接内容，我应该怎么做？

相关话题