I’ve been getting reports of this warning message from my members. Doesn’t come up much but it is being noticed. Can I assume there is nothing to do here and it’s not as serious as it appears? “Extreme load” sounds like a huge problem. But it does go away almost immediately and search works again. I’d appreciate any guidance on troubleshooting steps. Thanks! :seedling: site is under extreme load, search is disabled, try again later

I’m not so sure it’s something that needs troubleshooting. But maybe it could be handled differently? https://review.discourse.org/t/feature-when-under-extreme-load-disable-search/4538/3

You should be concerned, I would look at your web crawler report in the admin dashboard.

That will be triggered when your web requests are coming faster than your server can handle. For example, if you have 4 unicorns and, on average, need 200ms to fully process a request, your capacity is 20 requests per second. If, for a moment, you get 40 requests per second, the extra requests will sit in a queue waiting, and that message will be show. Also, you can’t go blindly setting up more unicorns, as the process to fully answer a web request involves a lot of moving parts that should be carefully evaluated. Discourse gained a lot of those graceful degradation features recently as we work to scale out and handle some crazy level of traffic for the largest Discourse instances on the internet.

Looks like we did get an increase in web crawler page views in recent days. But I’m not sure what if anything there is I can or should do about it. Personally, I am ok with a notice to members from time to time when the server is under higher than normal load, preventing searching temporarily. But maybe the “extreme load” messaging could be moderated a bit, to say “server is busy”. [29%20AM]

[image] tobiaseigen: But I’m not sure what if anything there is I can or should do about it Blacklist the rogue crawler user-agent in site settings. There are a lot of really bad crawlers on the internet these days.

Hmm, only 1800 pageviews in 24 hours by a crawler should not put that much extra load on your server though. It might be worth opening your access log and just watch the requests come in when this happens, it could point to the real issue. It could be someone trying to hack you, or hammering your API with requests.

I Just got a report of another similar looking notification. We are doing an AMA and have a few more people than usual reading and posting in the forum, but I am not convinced that this is extreme load. Maybe a plugin like Discourse Who's Online is causing additional load? [51%20AM] [image] bartv: Hmm, only 1800 pageviews in 24 hours by a crawler should not put that much extra load on your server though. It might be worth opening your access log and just watch the requests come in when this happens, it could point to the real issue. It could be someone trying to hack you, or hammering your API with requests. Thanks! I will look into this now. [image] Falco: Discourse gained a lot of those graceful degradation features recently as we work to scale out and handle some crazy level of traffic for the largest Discourse instances on the internet. Is there a way to disable these in an admin setting and just let people wait if it is getting slow? I think our site is still not especially busy.

If performance degrades to the point of timeouts it won’t feel slow, it will just feel broken.

Ignoring these warnings is definitely not a good idea!

I’m getting this extreme load notification a lot recently. I have a sports forum and it’s usually when there are people commenting on the one topic about a particular match at the same time. Is there any guide or help on what I can check to look at logs or the server to see if it’s up to speed. It wasn’t a problem until the last few weeks.

How serious is "site is under extreme load, search is disabled, try again later"

Product Support

codinghorror (Jeff Atwood) August 18, 2019, 9:00pm 12

Do you think we could have regressed on logged-in user posting performance @sam?

Topic		Replies	Views
Heavy load and search is disabled? Product Support	1	549	September 4, 2019
Extreme Load Error After Upgrading to 3.3.0.beta3-dev Yesterday (on Prem) Self-hosting	13	661	June 10, 2024
Extreme load error Self-hosting	19	2075	August 13, 2023
Due to extreme load, this is temporarily being shown to everyone as a logged out user would see it Product Support	12	3240	March 26, 2020
Large forums with 1+ MM posts, how's your Search performing? Self-hosting search , server-resources	10	1877	May 12, 2020

How serious is "site is under extreme load, search is disabled, try again later"

Related topics