# Extreme belasting/schijf-IO/CPU/geheugengebruik vraag

**URL:** <https://meta.discourse.org/t/extreme-load-disk-io-cpu-memory-usage-question/171097>\
**Category:** Self-hosting\
**Tags:** server-resources\
**Created:** [23 november 2020 om 22:59 UTC](https://meta.discourse.org/t/extreme-load-disk-io-cpu-memory-usage-question/171097 "2020-11-23T22:59:28Z")\
**Posts on this page:** 1\
**Showing post:** 1

<div class="post-metadata">

**Author:** ![ckshen](https://avatars.discourse-cdn.com/v4/letter/c/ad7895/32.png) [@ckshen](https://meta.discourse.org/u/ckshen)\
**Post date:** [23 november 2020 om 22:59 UTC](https://meta.discourse.org/t/extreme-load-disk-io-cpu-memory-usage-question/171097/1 "2020-11-23T22:59:28Z")

</div>

Hi, Recently our instance have been getting more “extreme load” messages. Today it happened at 9:40am.

I looked at our server log. CPU and load seemed ok at 9:40am:

 ![image](https://global.discourse-cdn.com/meta/original/3X/e/e/eeb40de35e9e73ab9d0997cfc2bc4e8ac65e5bd4.png)

Memory is also quite consistent during the day:

 ![image](https://global.discourse-cdn.com/meta/original/3X/4/c/4c65d977d65411472da5eded7ff6eafbfcd38b9b.png)

The spike seemed to be with disk i/o and outbound/ inbound bandwidth:

 ![f](https://global.discourse-cdn.com/meta/original/3X/7/3/7368a4a942e980284af074a3b603bc1db0b75868.png)

 ![ff](https://global.discourse-cdn.com/meta/original/3X/c/5/c515f2ffd4d423a71a81feefa1121a9b069234e6.png)

That led me down the path of suspecting that it was crawler request at 9:40am. But I don’t know if there is a way to check that. I looked at the list of crawlers and the number of requests, most of them come from Google and Bing so for sure we aren’t going to block them.

That led me to the questions

- is there a log where i can tell who’s accessing the site at a given point in time?
- is there a way to have the crawlers spread out their requests since these are ‘good’ crawlers?
- will throwing more CPU/ memory at the server help with the situation? I am a bit skeptical about that since CPU/ memory usage didn’t spike. is 80% average memory utilization too high?

We are at 2 vCPUs/ 2gb memory. We set the instance at 4 unicorn workers, which seems to be in line with the amount of ram that we have.

---

_[View the full topic](https://meta.discourse.org/t/extreme-load-disk-io-cpu-memory-usage-question/171097)._
