Sidekiq was (seemingly happily) running, but it seemed to be stuck since the update to 3.4 with about 1000 jobs queued. Since updates often do rebakes or async things, we didn’t really see that as something suspicious.
A restart of the process did the trick. I suspect the who’s online plugin might be the culprit but I’m not 100% sure.