Long Running Sidekiq Job Restarting Internal Code

Here are some ideas:

  • Push the data via the API (but then you’ll hit rate limits)
  • run an external script, especially if it just needs to get the initial batch of data pulled in and updates will take less time