Hi! I have discourse on docker, and it never seems to use any swap when RAM is being used too much, making it so it crashes or say fatal error: out of memory allocating heap arena map if i try to rebuild, unless i reboot every few hours it doesnt seem to work. Does anyone know how to fix this? Thanks, Kian

I changed back to MPM prefork and apache hasnt crashed in 3 days. Im hoping this is it and its all fixed. Thanks for all the help :slight_smile:

Assuming you’re on linux, what does free -h show? (Preferably, immediately after restart, and also shortly before the error.)

Hi! it was at 40 ive now set it to 60.

[Screenshot_440] The system always caches large chunks of RAM, and swap is never used even when the RAM has high usage.

I think the two parts of the output to concentrate on are the 5.5G of available memory and the 0B of used swap. Or maybe the 9G of free swap. The 5.5G + 9G tells you how much headroom you have. The amount of memory used for buffers and cache is dynamic and should never cause a shortage. I think with a time to failure of only a few hours, I’d run a vmstat 5 and capture the output, in such a way that you can see the final moments. I used to use a cron job to run vmstat 5 5 into a log file every 10 minutes. It’s possible with misbehaving software that it will very quickly use all available resources. In which case a log of ps uax every few minutes - in order to get a few snapshots at the crucial moments - could be very useful. It’s also possible that some other limits are in play. Presumably this is a vanilla installation on a vanilla OS, with nothing else running and no special configuration?

Hi! How would I go about writing vmstat 5 to a log every 10mins? And how would I get ps uax to write to a log every few mins? Yes its a vanilla 18.04 Ubuntu Server install. Only got stuff like apache, docker, etc.

Ive just remembered also I have Varnish Cache installed which explains the RAM which is cached. But i dont see why Discourse wont use swap also. I set its allocation a few days ago with a docker command to set its swap limit but it did nothing

[תמונה] kianwalters05: How would I go about writing vmstat 5 to a log every 10mins? And how would I get ps uax to write to a log every few mins? Here’s a one-liner which is cheap and cheerful (cron being a better way) sh -c 'rm -f /tmp/stop; while [ ! -e /tmp/stop ]; do (date; uptime; free; ps faux; vmstat 5 5) >> /var/log/monitor.log; sleep 600; done' & It’ll run forever: to stop it, touch /tmp/stop The log will appear in /var/log/monitor.log - use tail -99 to see the final throes, or less to page through it. Somehow you need to find the sections in the log which show the trouble developing. [תמונה] kianwalters05: But i dont see why Discourse wont use swap also It feels like you’re asking yourself the wrong question here. It’s the linux kernel which looks after virtual memory, including the use of buffers and the use of swap. If free reports that swap is configured, that’s as it should be and you have nothing to do. Your real question is, why is my discourse not running well, why does it need to be restarted, and why am I seeing the fatal error. I would very much recommend you retitle this topic as Why “fatal error: out of memory allocating heap arena map”? But also, I worry that you seem to have several distinct observations: sometimes discourse crashes sometimes I see “fatal error:… heap arena map” when I rebuild sometimes I need to reboot every few hours and it’s not clear to me exactly how those observations interact. what makes you believe discourse crashed: what is the observation? do you always see “fatal error:” on a rebuild? why are you rebuilding? what prompts you to reboot, and do you mean reboot the server? It would good to hear the answers!

[תמונה] kianwalters05: I set its allocation a few days ago with a docker command to set its swap limit but it did nothing Hmm, what did you do? What does docker stats --no-stream --no-trunc report for MEM USAGE / LIMIT and MEM %? (In my case, the LIMIT is something a little under the machine’s physical memory. Perhaps this means that nothing running within the container is likely to cause swapping, and you could see a process fail to allocate memory even when there’s little or no swap in use.)

Hi! I believe discourse has crashed cause when I go to the domain I get Nginx 502 Bad Gateway. The docker container is still up though. Yes, apart from the odd occasion. I rebuilt it as that often fixed the 502 bad gateway for a while. And I reboot the server, so see if that fixes the error and it can often work but more than likely it wont and a rebuild fixes it for a while. Ill also get that error log soon

Discourse לא צורך הרבה RAM

תמיכה התקנה

Benjamin_D (Benjamin Decotte) 1 באוגוסט,‏ 2021,‏ 12:08pm 3

maybe swappiness is set to 0 ?
cat /proc/sys/vm/swappiness

נושא		תגובות	צפיות
Discourse Docker HW reserved/used (CPU, RAM, Disk) and how to manage it Self-hosting server-resources	5	993	16 במאי,‏ 2023
Discourse installation has been getting slower and slower and slower Self-hosting server-resources	36	2348	15 באפריל,‏ 2023
Is 1GB RAM enough for both WordPress and Discourse? Self-hosting server-resources	21	5073	3 במרץ,‏ 2017
Memory is running out and Discourse stops working Bug	74	15314	17 בפברואר,‏ 2015
Crashing with out of memory error when opening a topic Product Support server-resources	6	1165	19 בינואר,‏ 2019

Discourse לא צורך הרבה RAM

נושאים קשורים