# How serious is "site is under extreme load, search is disabled, try again later"
**URL:** https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900
**Category:** Support
**Created:** [15 באוגוסט, 2019, 4:39pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900 "2019-08-15T16:39:10Z")
**Posts on this page:** 19
**Page:** 1
### Author:  [@tobiaseigen](https://meta.discourse.org/u/tobiaseigen)
#### Post date: [15 באוגוסט, 2019, 4:39pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/1 "2019-08-15T16:39:10Z")
I’ve been getting reports of this warning message from my members. Doesn’t come up much but it is being noticed. Can I assume there is nothing to do here and it’s not as serious as it appears? “Extreme load” sounds like a huge problem. But it does go away almost immediately and search works again.
I’d appreciate any guidance on troubleshooting steps. Thanks! 🌱
> site is under extreme load, search is disabled, try again later
---
### Author:  [@Mittineague](https://meta.discourse.org/u/Mittineague)
#### Post date: [15 באוגוסט, 2019, 4:51pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/2 "2019-08-15T16:51:48Z")
I’m not so sure it’s something that needs troubleshooting. But maybe it could be handled differently?
[https://review.discourse.org/t/feature-when-under-extreme-load-disable-search/4538/3](https://review.discourse.org/t/feature-when-under-extreme-load-disable-search/4538/3)
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [15 באוגוסט, 2019, 4:53pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/3 "2019-08-15T16:53:19Z")
You should be concerned, I would look at your web crawler report in the admin dashboard.
---
### Author:  [@Falco](https://meta.discourse.org/u/Falco)
#### Post date: [15 באוגוסט, 2019, 5:06pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/4 "2019-08-15T17:06:49Z")
That will be triggered when your web requests are coming faster than your server can handle.
For example, if you have 4 unicorns and, on average, need 200ms to fully process a request, your capacity is 20 requests per second.
If, for a moment, you get 40 requests per second, the extra requests will sit in a queue waiting, and that message will be show. Also, you can’t go blindly setting up more unicorns, as the process to fully answer a web request involves a lot of moving parts that should be carefully evaluated.
Discourse gained a lot of those graceful degradation features recently as we work to scale out and handle some crazy level of traffic for the largest Discourse instances on the internet.
---
### Author:  [@tobiaseigen](https://meta.discourse.org/u/tobiaseigen)
#### Post date: [15 באוגוסט, 2019, 5:34pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/5 "2019-08-15T17:34:04Z")
Looks like we did get an increase in web crawler page views in recent days. But I’m not sure what if anything there is I can or should do about it. Personally, I am ok with a notice to members from time to time when the server is under higher than normal load, preventing searching temporarily. But maybe the “extreme load” messaging could be moderated a bit, to say “server is busy”.
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [15 באוגוסט, 2019, 8:55pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/6 "2019-08-15T20:55:51Z")
> [@tobiaseigen](#):
>
> But I’m not sure what if anything there is I can or should do about it
Blacklist the rogue crawler user-agent in site settings. There are a lot of really bad crawlers on the internet these days.
---
### Author:  [@bartv](https://meta.discourse.org/u/bartv)
#### Post date: [16 באוגוסט, 2019, 6:39am UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/7 "2019-08-16T06:39:39Z")
Hmm, only 1800 pageviews in 24 hours by a crawler should not put _that_ much extra load on your server though. It might be worth opening your access log and just watch the requests come in when this happens, it could point to the real issue. It could be someone trying to hack you, or hammering your API with requests.
---
### Author:  [@tobiaseigen](https://meta.discourse.org/u/tobiaseigen)
#### Post date: [16 באוגוסט, 2019, 2:27pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/8 "2019-08-16T14:27:48Z")
I Just got a report of another similar looking notification. We are doing an AMA and have a few more people than usual reading and posting in the forum, but I am not convinced that this is extreme load. Maybe a plugin like [Discourse Who's Online](https://meta.discourse.org/t/whos-online-plugin-discourse-whos-online/52345) is causing additional load?
> [@bartv](#):
>
> Hmm, only 1800 pageviews in 24 hours by a crawler should not put _that_ much extra load on your server though. It might be worth opening your access log and just watch the requests come in when this happens, it could point to the real issue. It could be someone trying to hack you, or hammering your API with requests.
Thanks! I will look into this now.
> [@Falco](#):
>
> Discourse gained a lot of those graceful degradation features recently as we work to scale out and handle some crazy level of traffic for the largest Discourse instances on the internet.
Is there a way to disable these in an admin setting and just let people wait if it is getting slow? I think our site is still not especially busy.
---
### Author:  [@Stephen](https://meta.discourse.org/u/Stephen)
#### Post date: [16 באוגוסט, 2019, 2:30pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/9 "2019-08-16T14:30:42Z")
If performance degrades to the point of timeouts it won’t feel slow, it will just feel broken.
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [17 באוגוסט, 2019, 8:21am UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/10 "2019-08-17T08:21:50Z")
Ignoring these warnings is definitely not a good idea!
---
### Author:  [@thefreekick](https://meta.discourse.org/u/thefreekick)
#### Post date: [18 באוגוסט, 2019, 4:45pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/11 "2019-08-18T16:45:11Z")
I’m getting this extreme load notification a lot recently.
I have a sports forum and it’s usually when there are people commenting on the one topic about a particular match at the same time. Is there any guide or help on what I can check to look at logs or the server to see if it’s up to speed. It wasn’t a problem until the last few weeks.
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [18 באוגוסט, 2019, 9:00pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/12 "2019-08-18T21:00:54Z")
Do you think we could have regressed on logged-in user posting performance @sam?
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [18 באוגוסט, 2019, 10:55pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/13 "2019-08-18T22:55:35Z")
I am seeing an N+1 on meta for sure that we need to fix ASAP
Will log some items to get this sorted. That said, once site is overloaded admins have the ability to tweak 2 things.
1. You can give the instance more resources, (more memory for PG or more unicorn workers)
2. You can adjust the anon threshold per:
>
DISCOURSE\_FORCE\_ANONYMOUS\_MIN\_QUEUE\_SECONDS and DISCOURSE\_FORCE\_ANONYMOUS\_MIN\_PER\_10\_SECONDS
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [19 באוגוסט, 2019, 6:25am UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/14 "2019-08-19T06:25:50Z")
I did fix one N+1 in the discourse-voting plugin here:
[https://github.com/discourse/discourse-voting/commit/9b4f233b9d33a946f626597aaf3863d2305b8809](https://github.com/discourse/discourse-voting/commit/9b4f233b9d33a946f626597aaf3863d2305b8809)
Will see if anything else yells out
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [19 באוגוסט, 2019, 7:27am UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/15 "2019-08-19T07:27:27Z")
Found another N+2 here:
[https://github.com/discourse/discourse/commit/accbbded15974846523c3aeca85a59454e3f2f05](https://github.com/discourse/discourse/commit/accbbded15974846523c3aeca85a59454e3f2f05)
Looking to see if anything more pops up.
---
### Author:  [@TheBestPessimist](https://meta.discourse.org/u/TheBestPessimist)
#### Post date: [19 באוגוסט, 2019, 10:18am UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/16 "2019-08-19T10:18:45Z")
Q: What is an “N+1” ? Although i’m a dev (java), i don’t think i ever came upon this term before.
---
### Author:  [@michaeld](https://meta.discourse.org/u/michaeld)
#### Post date: [19 באוגוסט, 2019, 11:06am UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/17 "2019-08-19T11:06:37Z")
Here is a (more or less Java-related) article that explains this issue:
> **[N+1 problem in Hibernate & Spring Data JPA](https://www.javacodemonk.com/what-is-n-1-problem-in-hibernate-how-will-you-identify-and-solve-it-894097b9)**
>
> N+1 problem is a performance issue in Object Relational Mapping that fires multiple Select Queries in database for a single select query at application layer. Hibernate provides multiple ways to identify and prevent this problem.
---
### Author:  [@system](https://meta.discourse.org/u/system)
#### Post date: [3 במרץ, 2023, 8:08am UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/18 "2023-03-03T08:08:43Z")
---
### Author:  [@Stephen](https://meta.discourse.org/u/Stephen)
#### Post date: [3 במרץ, 2023, 6:39pm UTC](https://meta.discourse.org/t/how-serious-is-site-is-under-extreme-load-search-is-disabled-try-again-later/125900/19 "2023-03-03T18:39:21Z")