# How to allow user-agent access to private discourse?

**URL:** <https://meta.discourse.org/t/how-to-allow-user-agent-access-to-private-discourse/35537>\
**Category:** Support\
**Created:** [November 13, 2015, 11:49pm UTC](https://meta.discourse.org/t/how-to-allow-user-agent-access-to-private-discourse/35537 "2015-11-13T23:49:55Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![Mittineague](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mittineague/32/114259_2.png) [@Mittineague](https://meta.discourse.org/u/Mittineague)\
**Post date:** [November 14, 2015, 12:09am UTC](https://meta.discourse.org/t/how-to-allow-user-agent-access-to-private-discourse/35537/4 "2015-11-14T00:09:26Z")

</div>

> [@Joey\_Tuan](#):
>
> Can we edit the file?

AFAIK there should be no need to as long as your Security Setting is  
`allow_index_in_robots_txt: true`

I’m wondering if it isn’t so much a crawl thing and that they need to be allowed in the robots.txt file or if it is a widget permissions thing.

---

_[View the full topic](https://meta.discourse.org/t/how-to-allow-user-agent-access-to-private-discourse/35537)._