# Can't login after removing all bot user agents from site setting
**URL:** https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704
**Category:** Support
**Created:** [November 23, 2017, 7:56pm UTC](https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704 "2017-11-23T19:56:17Z")
**Posts on this page:** 7
**Page:** 1
### Author:  [@atb1248](https://meta.discourse.org/u/atb1248)
#### Post date: [November 23, 2017, 7:56pm UTC](https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704/1 "2017-11-23T19:56:17Z")
Disclaimer : I have 24 hours of experience with Discourse.
I just set up a new Discourse (amazing deployment experience by the way, https support was magic), in invite-only mode. I wanted to disallow crawlers and referencement and might have gone too far in this. I set `allow index in robots txt` to false but also **removed all the bot user agents from the list** in a setting that was just under. Sadly, I cannot remember the name of this setting or find it in the api. Since this, it’s impossible to access the admin panel and trying another browser doesn’t work since the login doesn’t work either (there’s no button).
the `robots.txt` looks fine:
> User-agent: \*
> Disallow: /
I am not 100% confident that my emptying of that user-agent list is the root cause, so I’m open to other interpretations.
I do not have an API key yet, so I suppose I’ll have to fix this by SSH. Any idea on the steps involved to rebuild that list and fix this?
---
### Author:  [@zogstrip](https://meta.discourse.org/u/zogstrip)
#### Post date: [November 23, 2017, 8:19pm UTC](https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704/2 "2017-11-23T20:19:34Z")
Have you tried logging in using [https://your.discourse/u/admin-login](https://your.discourse/u/admin-login)?
---
### Author:  [@atb1248](https://meta.discourse.org/u/atb1248)
#### Post date: [November 23, 2017, 9:24pm UTC](https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704/3 "2017-11-23T21:24:47Z")
This does indeed work for login.
It appears I do not have access to the admin and settings pages though, here’s a screenshot from the front page (no menu in headers).
And another from `/admin`.
---
### Author:  [@zogstrip](https://meta.discourse.org/u/zogstrip)
#### Post date: [November 23, 2017, 9:42pm UTC](https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704/4 "2017-11-23T21:42:28Z")
> [@atb1248](#):
>
> I suppose I’ll have to fix this by SSH. Any idea on the steps involved to rebuild that list and fix this?
Here’s how to fix your issue
```plaintext
# ssh into your server
cd /var/discourse
./launcher enter app
rails c
SiteSetting.crawler_user_agents = "*"
```
BTW, if your site is invite only, no bot will be able to crawl it 😉
---
### Author:  [@atb1248](https://meta.discourse.org/u/atb1248)
#### Post date: [November 23, 2017, 9:49pm UTC](https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704/5 "2017-11-23T21:49:23Z")
I’m unable to ssh into the machine until tomorrow, at which point I’ll let you know the result of those commands.
Thanks a lot for the quick responses.
---
### Author:  [@atb1248](https://meta.discourse.org/u/atb1248)
#### Post date: [November 24, 2017, 2:33pm UTC](https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704/6 "2017-11-24T14:33:58Z")
This did it. Thanks a lot for the quick and concise help!
---
### Author:  [@j.jaffeux](https://meta.discourse.org/u/j.jaffeux)
#### Post date: [November 24, 2017, 3:30pm UTC](https://meta.discourse.org/t/cant-login-after-removing-all-bot-user-agents-from-site-setting/74704/7 "2017-11-24T15:30:04Z")