We were having problems with backup jobs failing after sidekiq restarts, then we increased UNICORN_SIDEKIQ_MAX_RSS as suggested here.
This helped for a while, but since our latest updates (we’re at 3725fd8 right now) we’re seeing:
Incorrect information in /admin
- Latest backup reported is not there in /backups
- "A check for updates has not been performed lately. Ensure sidekiq is running. " (sidekiq IS running, “latest” is blank, but /admin/upgrade shows “New Version Available!”
Sidekiq restarts because of “using too much memory” about every half hour.
The backup files do not appear in /backups.
I’m seeing “Job exception: can’t modify frozen String” and “Job exception: deadlock; recursive locking” in /logs, which I believe are new since we started this round of updates.
./launcher rebuilds (a couple of times)
Changing UNICORN_SIDEKIQ_MAX_RSS up to 3000 (it’s back at 1000 now)
Our last successful backup was on the 16th, but since about a week the backup has only run properly about half the time.
What can we try next?