I want Google to index the content in the link format domain/u/username, what should I do? I have removed the Disallow: /u part to let the link format domain.com/u be indexed by Google, but what should I do if I want the slug format domain/u/username to be indexed by Google? Is there any other conf…

Hello :waving_hand: Is this site setting enabled on your site? hide user profiles from public If yes, than disable it and you’ll be able to access user profiles without login too.

Are you sure your users are equally happy that you would like to tell whole wide world about their membership and some other stuff?

but I still can’t submit the link in the form of domain/u/username to index with Google, what else do I need to open? (I have attached the image for you to see the status) [image]

If I remember right that limit comes a bit deeper than robots.txt. Sure, it is quite fast test allowing /u in robots.txt. But if it comes deeper from the core you may need a plugin. Dig here. That was a thing perhaps a year ago, came along with SEO-stuff, and there was strong reason why it is not a…

I put it in robots.txt (attached image) but it didn’t work, so I came here to ask you. [image]

Does “View live test” give you any more information?

It’s probably because user profiles send this HTTP header: x-robots-tag: noindex You can see it if you run this command in a terminal, replacing <url> with the URL of a user profile: curl -sSL -D - -o /dev/null <url> If you remove the robots.txt rule, Google will see that header and deindex the…

I know the url is Noindex but I don’t know where to edit it in the source discourse. In the robots.txt file, the Disallow: /u part has been removed. I have attached a photo. [image]

Help me index slug into username of source code? I want to open index for this slug domain like this example: https://domain.com/u/toannguyen/activity (example link), what do I need to do in the discourse source code? Currently, when I submit this type of link in Google Search Console, it says it …

我希望Google索引域名/u/用户名格式的链接内容，我应该怎么做？

支持

toanvoc (Toan Nguyen) 2024 年9 月 22 日 08:35 13

我需要做什么本地社区发展模型？我已经向我的会员公开了！

话题		回复	浏览量
Indexing User Profiles Support	2	98	2025 年9 月 4 日
Excluding user profiles in robots.txt (or allow edit of file) Feature	4	2554	2014 年5 月 24 日
Why there are lots of Disallow rule in robots.txt? Support	34	4738	2020 年12 月 22 日
How to edit robot.txt for indexing user profiles? Support	7	1018	2023 年4 月 5 日
Google complaining – Indexed, though blocked by robots.txt Support	22	2625	2019 年12 月 13 日

我希望Google索引域名/u/用户名格式的链接内容，我应该怎么做？

相关话题