I see this Sidekiq CPU usage pattern (the growing part is Sideqik): [This image displays a graph showing the CPU usage percentages of various applications over time, with lines indicating the usage for "apps.plugin," "auditd," "backup," "bash," "boot," and "build," on a computer screen. (Captioned by AI)] Maybe connected with Increased CPU Usage since 3.4.0.beta4-dev ( 58f75ed205 ) upgrade? How should I investigate?

Sorry for the hassle. The staging site was the culprit. Maildev was not running, so all mails failed. I should sleep more.

when did you rebuild your container last? if it was a while ago I recommend you rebuild now.

The first usage drop was after the recommended rebuild. Last rebuild is one hour old but with same usage pattern.

have you looked at sidekiq, is there a backlog? visit /sidekiq

[The image shows a summary panel with a counter of 37 job applications, 5 candidates interviewed, and various zeroes across different categories, including rejected applicants, candidates in the applicant pool, and job openings. (Captioned by AI)]

./launcher enter app apt-get update && apt-get install -y htop htop Is CPU high at the moment? If it is high, then try to inspect CPU on a process that is running high using: ps top -H -p PID_OF_HIGH_CPU

[The image displays a Unix system running on Mindowski, showing various running processes, system status, and memory usage. (Captioned by AI)]

that is not showing any concerning CPU amount, CPU is hovering on zero now across all processes?

There is no longer running process taking much time. HTOP shows ever changing CPU utilisation. Netplan’s stats attribute the raising CPU utilisation to sideqik: [The image shows a graphical audio editing interface with various waveforms and tracks displayed, along with a highlighted section indicating five percent progress. (Captioned by AI)] Is there any profiling tooling for sideqik I could enable?

the key is that you need to catch stuff misbahaving, finding background radiation is super hard.

Reading app/jobs/base.rb and MethodProfiler, I would like to learn if the collected metrics could be saved to a report in an accumulated way (as sums of time spent in different jobs) in a production environment. I understand that detailed logging can be enabled via ENV["DISCOURSE_LOG_SIDEKIQ"], but I expect this to generate a large amount of data in a production environment.

CPU usage increases steadily

Product Support

thoka (Thomas Kalka) March 8, 2025, 6:01am 16

I wrote here about what I learned:

Topic		Replies	Views
Increased CPU Usage since 3.4.0.beta4-dev ( 58f75ed205 ) upgrade Product Support	11	490	February 7, 2025
Strange CPU usage since latest upgrade Self-hosting server-resources	14	1221	April 11, 2019
Sidekiq is consuming too much memory, restarting Self-hosting	38	9518	October 13, 2020
Locking issues in sidekiq jobs? Product Support	7	1825	August 26, 2019
Higher idle process activity after upgrade Self-hosting	7	886	May 25, 2020

CPU usage increases steadily

Related topics