# Goodbye Sidetiq
**URL:** https://meta.discourse.org/t/goodbye-sidetiq/12476
**Category:** Feature
**Created:** [2014年二月5日 22:38 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476 "2014-02-05T22:38:31Z")
**Posts on this page:** 20
**Page:** 1
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2014年二月5日 22:38 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/1 "2014-02-05T22:38:31Z")
We have been plagued with problems related to our scheduler [sidetiq](https://github.com/tobiassvn/sidetiq).
In particular we have had a few major recurring issues related to high CPU
[https://meta.discourse.org/t/performance-issue-on-digital-ocean-with-discourse-docker/11895](https://meta.discourse.org/t/performance-issue-on-digital-ocean-with-discourse-docker/11895)
We have been working to address them upstream, however even once addressed there are some design issues that we need fixed as well.
Recently, I was debugging erratic perf issue with @supermathie here and found a second serious issue.
Sidetiq always schedules every job at exactly the same time, this leads to periods where the same job on every site we host runs at the same time leading to network saturation.
I have been building a light weight scheduler to address the perf and scheduling issues. I expect to have it done today.
So, this is just an upfront warning that the scheduler is changing, if you notice any new issues with scheduled jobs please let me know.
Commit that activates this is:
[https://github.com/discourse/discourse/commit/e1f293ad66d8557cca7054e82b96a4d1381d9e4a](https://github.com/discourse/discourse/commit/e1f293ad66d8557cca7054e82b96a4d1381d9e4a)
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2014年二月5日 22:38 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/2 "2014-02-05T22:38:46Z")
This topic is now pinned. It will appear at the top of its category until it is either unpinned by a moderator, or the Clear Pin button is pressed.
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2014年二月5日 23:43 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/3 "2014-02-05T23:43:47Z")
Note: the UI is much improved over what sidetiq was giving us:
---
### Author:  [@riking](https://meta.discourse.org/u/riking)
#### Post date: [2014年二月6日 00:45 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/4 "2014-02-06T00:45:21Z")
Wow, that looks really nice! Will you be adding a link to it from the admin panel?
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2014年二月6日 00:58 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/5 "2014-02-06T00:58:20Z")
Sure, open to that, where would you link this ?
---
### Author:  [@ambethia](https://meta.discourse.org/u/ambethia)
#### Post date: [2014年二月6日 15:59 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/6 "2014-02-06T15:59:35Z")
This looks like something that’s a candidate for extracting into it’s own library. Thoughts?
---
### Author:  [@zogstrip](https://meta.discourse.org/u/zogstrip)
#### Post date: [2014年二月6日 16:09 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/7 "2014-02-06T16:09:55Z")
> [@ambethia](#):
>
> This looks like something that’s a candidate for extracting into it’s own library. Thoughts?
Will require some real world usage first 😉
---
### Author:  [@eviltrout](https://meta.discourse.org/u/eviltrout)
#### Post date: [2014年二月6日 16:46 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/8 "2014-02-06T16:46:52Z")
Nice, I’m glad to ditch a freedom patch too.
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2014年二月7日 03:26 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/9 "2014-02-07T03:26:40Z")
I am still holding back to see if tobias takes in all the features we need.
---
### Author:  [@jhofker](https://meta.discourse.org/u/jhofker)
#### Post date: [2014年二月7日 19:09 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/10 "2014-02-07T19:09:32Z")
What’s the upgrade impact (if any) of this change and should the install/upgrade doc(s) be updated? [https://github.com/discourse/discourse/blob/master/docs/INSTALL-ubuntu.md](https://github.com/discourse/discourse/blob/master/docs/INSTALL-ubuntu.md)
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [2014年二月7日 19:27 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/11 "2014-02-07T19:27:39Z")
We’re going to switch over to the Docker install instructions as the new standard next week. @sam I know that is on your list, but make sure.
The no-Docker, old style install will be available but not our primary supported or recommended install any more. So we’ll move it around a bit.
---
### Author:  [@jhofker](https://meta.discourse.org/u/jhofker)
#### Post date: [2014年二月7日 19:30 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/12 "2014-02-07T19:30:57Z")
What’s the transition from an environment running no-Docker to Docker like?
(Sorry if I’m being annoying. Just wondering how much time I need to budget for this transition. 😄 (I have a Bitnami-created VM hosted on Azure))
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [2014年二月7日 20:26 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/13 "2014-02-07T20:26:26Z")
Yes. We also want to have a “howto convert from regular to Docker install” posted soon. @sam has done a number of conversions from old-style Discourse install to new Docker installs now and has documented the process internally.
@zogstrip and @sam are working on necessary import/export improvements and once that is ready, it should go up.
---
### Author:  [@michaeld](https://meta.discourse.org/u/michaeld)
#### Post date: [2014年二月8日 14:43 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/14 "2014-02-08T14:43:15Z")
> [@sam](#):
>
> So, this is just an upfront warning that the scheduler is changing, if you notice any new issues with scheduled jobs please let me know.
We’re having issues.
The sidekiq/scheduler page shows that all recurring jobs are ‘Not scheduled yet’
Hitting the ‘Trigger’ button on for instance ‘Version Checks’ results in a screen showing “Internal Server Error” and this in the logs:
```
ArgumentError - comparison of Class with Class failed:
/var/www/discourse/lib/scheduler/web.rb:10:in `sort'
/var/www/discourse/lib/scheduler/web.rb:10:in `block (2 levels) in registered'
/var/www/discourse/vendor/gems/rails_multisite/lib/rails_multisite/connection_management.rb:45:in `with_connection'
/var/www/discourse/lib/scheduler/web.rb:8:in `block in registered'
```
From that moment on, the scheduler screen is broken (keeps showing ‘Internal Server Error’ until Sidekiq is restarted.
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2014年二月8日 20:30 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/15 "2014-02-08T20:30:06Z")
What version of ruby are you on ?
---
### Author:  [@michaeld](https://meta.discourse.org/u/michaeld)
#### Post date: [2014年二月8日 20:36 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/16 "2014-02-08T20:36:40Z")
ruby 2.0.0p353 (2013-11-22 revision 43784) [x86\_64-linux]
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2014年二月8日 20:50 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/18 "2014-02-08T20:50:03Z")
is there anything custom in your initializer, you are going to need to trace through the sidekiq initializer to see why its not doing an initial enqueue of the jobs
---
### Author:  [@michaeld](https://meta.discourse.org/u/michaeld)
#### Post date: [2014年二月8日 20:55 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/19 "2014-02-08T20:55:57Z")
(Your redis question apparently disappeared, but flushing redis _does_ make it recover from the “Internal Server Error” on sidekiq/scheduler)
The initializer is unmodified, actually this is a clean v0.9.8.4 checkout.
---
### Author:  [@sam](https://meta.discourse.org/u/sam)
#### Post date: [2014年二月8日 21:08 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/20 "2014-02-08T21:08:58Z")
Can you do a clean checkout of master?
---
### Author:  [@michaeld](https://meta.discourse.org/u/michaeld)
#### Post date: [2014年二月8日 21:16 UTC](https://meta.discourse.org/t/goodbye-sidetiq/12476/21 "2014-02-08T21:16:54Z")
Sidekiq does seem to work, I see a ‘stat’ job coming by, it’s only the scheduled jobs that are failing.
Hitting the “Trigger” button on “Version check” does seem to run the version check, the following keys appear in redis
```
1) "default:last_installed_version"
4) "default:missing_versions_count"
5) "default:critical_updates_available"
8) "default:last_version_check_at"
9) "default:discourse_latest_version"
10) "default:_scheduler_Jobs::VersionCheck"
14) "default:_scheduler_queue_"
```
Removing the key “`default:_scheduler_Jobs::VersionCheck`” fixes the Internal Server Error
```
127.0.0.1:6379> get "default:_scheduler_Jobs::VersionCheck"
"{\"next_run\":1391979510,\"prev_run\":1391893854,\"prev_duration\":327,\"prev_result\":\"OK\"}"
127.0.0.1:6379> del "default:_scheduler_Jobs::VersionCheck"
(integer) 1
```
[下一頁](https://meta.discourse.org/t/goodbye-sidetiq/12476.md?page=2)