I want Google to index the content in the link format domain/u/username, what should I do? I have removed the Disallow: /u part to let the link format domain.com/u be indexed by Google, but what should I do if I want the slug format domain/u/username to be indexed by Google? Is there any other conf…

Hello :waving_hand: Is this site setting enabled on your site? hide user profiles from public If yes, than disable it and you’ll be able to access user profiles without login too.

Are you sure your users are equally happy that you would like to tell whole wide world about their membership and some other stuff?

but I still can’t submit the link in the form of domain/u/username to index with Google, what else do I need to open? (I have attached the image for you to see the status) [image]

If I remember right that limit comes a bit deeper than robots.txt. Sure, it is quite fast test allowing /u in robots.txt. But if it comes deeper from the core you may need a plugin. Dig here. That was a thing perhaps a year ago, came along with SEO-stuff, and there was strong reason why it is not a…

I put it in robots.txt (attached image) but it didn’t work, so I came here to ask you. [image]

Does “View live test” give you any more information?

It’s probably because user profiles send this HTTP header: x-robots-tag: noindex You can see it if you run this command in a terminal, replacing <url> with the URL of a user profile: curl -sSL -D - -o /dev/null <url> If you remove the robots.txt rule, Google will see that header and deindex the…

I know the url is Noindex but I don’t know where to edit it in the source discourse. In the robots.txt file, the Disallow: /u part has been removed. I have attached a photo. [image]

Help me index slug into username of source code? I want to open index for this slug domain like this example: https://domain.com/u/toannguyen/activity (example link), what do I need to do in the discourse source code? Currently, when I submit this type of link in Google Search Console, it says it …

Google에서 domain/u/username 형식의 링크 콘텐츠를 인덱싱하고 싶은데 어떻게 해야 하나요?

지원

toanvoc (Toan Nguyen) 9월 22, 2024, 8:35오전 13

제가 해야 하는 지역 사회 개발 모델이 무엇인가요? 이 내용을 회원들에게 공개했습니다!

글		댓글	조회수
Indexing User Profiles Support	2	122	9월 4, 2025
Excluding user profiles in robots.txt (or allow edit of file) Feature	4	2580	5월 24, 2014
Why there are lots of Disallow rule in robots.txt? Support	34	4829	12월 22, 2020
How to edit robot.txt for indexing user profiles? Support	7	1085	4월 5, 2023
Google complaining – Indexed, though blocked by robots.txt Support	22	2676	12월 13, 2019

Google에서 domain/u/username 형식의 링크 콘텐츠를 인덱싱하고 싶은데 어떻게 해야 하나요?

Related topics