# Lot of sidekiq jobs during data import **URL:** \ **Category:** Support\ **Created:** [2016年十一月25日 07:25 UTC](https://meta.discourse.org/t/lot-of-sidekiq-jobs-during-data-import/53358 "2016-11-25T07:25:26Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![junaid\_pk14](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/junaid_pk14/32/67840_2.png) [@junaid\_pk14](https://meta.discourse.org/u/junaid_pk14)\ **Post date:** [2016年十一月25日 07:25 UTC](https://meta.discourse.org/t/lot-of-sidekiq-jobs-during-data-import/53358/1 "2016-11-25T07:25:26Z")
Hello Guys, We have a huge dataset(7 Lac user, 2.5 Lac threads, 5 million posts, 1.5 attachments, During import discourse created huge amount(5357085) of sidekiq jobs. It seems that we should keep running sidekiq during import time otherwise it would effect other functionalities. During import Discourse by default disable the outgoing email. I want to make sure again as we are going to import data for live system and don’t want to have suprises. @neil, @Falco What do you suggests? Thanks Regards, Junaid ---
**Author:** ![pfaffman](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/pfaffman/32/120154_2.png) [@pfaffman](https://meta.discourse.org/u/pfaffman)\ **Post date:** [2016年十一月25日 17:27 UTC](https://meta.discourse.org/t/lot-of-sidekiq-jobs-during-data-import/53358/2 "2016-11-25T17:27:03Z")
Generally you should turn off Sidekiq during import (it’ll be faster) and then turn it on when it’s done. It’ll do things like rebake every post (all 5 million of them), so it’ll take a while. > [@Migrate a phpBB3 forum to Discourse](https://meta.discourse.org/t/migrate-a-phpbb3-forum-to-discourse/30810/1): > > Discourse will start and Sidekiq will begin post-processing all the imported posts. This can take a considerate amount of time. You can watch the progress by logging in as admin and visiting [http://discourse.example.com/sidekiq](http://discourse.example.com/sidekiq) ---
**Author:** ![system](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/system/32/443519_2.png) [@system](https://meta.discourse.org/u/system)\ **Post date:** [2019年四月1日 23:58 UTC](https://meta.discourse.org/t/lot-of-sidekiq-jobs-during-data-import/53358/3 "2019-04-01T23:58:03Z")
---
**Author:** ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)\ **Post date:** [2019年四月2日 00:24 UTC](https://meta.discourse.org/t/lot-of-sidekiq-jobs-during-data-import/53358/4 "2019-04-02T00:24:48Z")