We have been plagued with problems related to our scheduler sidetiq.
In particular we have had a few major recurring issues related to high CPUhttps://meta.discourse.org/t/performance-issue-on-digital-ocean-with-discourse-docker/11895?source_topic_id=12476
We have been working to address them upstream, however even once addressed there are some design issues that we need fixed as well.
Recently, I was debugging erratic perf issue with @supermathie here and found a second serious issue.
Sidetiq always schedules every job at exactly the same time, this leads to periods where the same job on every site we host runs at the same time leading to network saturation.
I have been building a light weight scheduler to address the perf and scheduling issues. I expect to have it done today.
So, this is just an upfront warning that the scheduler is changing, if you notice any new issues with scheduled jobs please let me know.
Commit that activates this is: