# Indexing User Profiles

**URL:** https://meta.discourse.org/t/indexing-user-profiles/345171
**Category:** Support
**Created:** [January 1, 2025, 9:29pm UTC](https://meta.discourse.org/t/indexing-user-profiles/345171 "2025-01-01T21:29:00Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![MihirR](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mihirr/32/475158_2.png) [@MihirR](https://meta.discourse.org/u/MihirR)
#### Post date: [January 1, 2025, 9:29pm UTC](https://meta.discourse.org/t/indexing-user-profiles/345171/1 "2025-01-01T21:29:00Z")

</div>

Hey everyone, happy new year :))

From what I know the users are made not to be indexed on Google or any search results. However, I have removed /u from `admin/customize/robots` so is that enough or there more changes to do, also if anyone is curious what I’m trying to do is that I would love my community users profile to be indexed on search engines.

---

<div class="post-metadata">

### Author: ![hameedacpa](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/hameedacpa/32/520681_2.png) [@hameedacpa](https://meta.discourse.org/u/hameedacpa)
#### Post date: [September 4, 2025, 6:25am UTC](https://meta.discourse.org/t/indexing-user-profiles/345171/2 "2025-09-04T06:25:58Z")

</div>

I have the same question

---

<div class="post-metadata">

### Author: ![hameedacpa](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/hameedacpa/32/520681_2.png) [@hameedacpa](https://meta.discourse.org/u/hameedacpa)
#### Post date: [September 4, 2025, 6:57am UTC](https://meta.discourse.org/t/indexing-user-profiles/345171/3 "2025-09-04T06:57:16Z")

</div>

I discovered option as in the photo

 ![image](https://global.discourse-cdn.com/meta/original/4X/9/1/2/912f6318b2d813db92cf414e709ee437a8daf2d3.png)

then I modified the robots.txt

```plaintext
# Block aggressive third-party crawlers

User-agent: mauibot
Disallow: /

User-agent: semrushbot
Disallow: /

User-agent: ahrefsbot
Disallow: /

User-agent: blexbot
Disallow: /

User-agent: seo spider
Disallow: /

# General rules for all crawlers

User-agent: \*
Disallow: /admin/
Disallow: /auth/
Disallow: /email/
Disallow: /session
Disallow: /user-api-key
Disallow: /badges
Disallow: /my
Disallow: /search
Disallow: /g

# Block low-value pages

Disallow: /u/ # user profiles
Disallow: /tag/ # tag indexes
Disallow: /\*.json # JSON API responses

# Block feeds (not useful for indexing)

Disallow: /t/*/*.rss
Disallow: /c/\*.rss

# Allow Googlebot (same rules as above)

User-agent: Googlebot
Disallow: /admin/
Disallow: /auth/
Disallow: /email/
Disallow: /session
Disallow: /user-api-key
Disallow: /badges
Disallow: /my
Disallow: /search
Disallow: /g
Disallow: /u/
Disallow: /tag/
Disallow: /*.json
Disallow: /t/*/*.rss
Disallow: /c/*.rss

# Point to sitemap

Sitemap: https://site.com/sitemap.xml

```