# Problems after import from semi-large forum

**URL:** https://meta.discourse.org/t/problems-after-import-from-semi-large-forum/34033
**Category:** Support
**Created:** [02.Октябрь.2015 10:14:30 UTC](https://meta.discourse.org/t/problems-after-import-from-semi-large-forum/34033 "2015-10-02T10:14:30Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![huulbaek](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/huulbaek/32/46692_2.png) [@huulbaek](https://meta.discourse.org/u/huulbaek)
#### Post date: [02.Октябрь.2015 10:14:30 UTC](https://meta.discourse.org/t/problems-after-import-from-semi-large-forum/34033/1 "2015-10-02T10:14:30Z")

</div>

Continuing the discussion from [Importing from Vanilla](https://meta.discourse.org/t/error-when-importing-from-vanilla/33716/3):

It took about 30 hours to import from Vanilla MySQL database. However, I have encountered a couple of issues that I hope someone could help me with.

- System reports a lot of queued jobs which stays constant at the same number - what does it even mean?

- Emails are not being sent - there are no connection attempts to the smtp server. I have another instance of Discourse running with exact same SMTP setup where it is working. SMTP testet ok on host via telnet. Can this be related to queued jobs?

- A lot of topics are without category - may be related to first problem?

---

<div class="post-metadata">

### Author: ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)
#### Post date: [02.Октябрь.2015 12:02:21 UTC](https://meta.discourse.org/t/problems-after-import-from-semi-large-forum/34033/3 "2015-10-02T12:02:21Z")

</div>

How many topics / posts / categories / users are you importing?

Topics that are missing categories are going to stay with missing categories, sounds like you have missing mapping somewhere.

I would not expect any emails to come through before the job queue clears, may take quite a few hours.

---

<div class="post-metadata">

### Author: ![huulbaek](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/huulbaek/32/46692_2.png) [@huulbaek](https://meta.discourse.org/u/huulbaek)
#### Post date: [02.Октябрь.2015 13:24:25 UTC](https://meta.discourse.org/t/problems-after-import-from-semi-large-forum/34033/4 "2015-10-02T13:24:25Z")

</div>

> [@sam](#):
>
> How many topics / posts / categories / users are you importing?

About 28.000 users - that was fast import, categories likewise. .I think it was 575.000 posts. Everything seems right in the MySQL database.

> [@sam](#):
>
> I would not expect any emails to come through before the job queue clears, may take quite a few hours.

The number is now 1.579.987 - so it seems to be going up if anything? 😱

---

<div class="post-metadata">

### Author: ![riking](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/riking/32/170938_2.png) [@riking](https://meta.discourse.org/u/riking)
#### Post date: [02.Октябрь.2015 19:11:38 UTC](https://meta.discourse.org/t/problems-after-import-from-semi-large-forum/34033/5 "2015-10-02T19:11:38Z")

</div>

> [@huulbaek](#):
>
> or you may need to add more Sidekiq workers.

This is what you want to do - change the app.yml to launch more Sidekiq workers to process all the work from the import, until that’s all done.

---

<div class="post-metadata">

### Author: ![huulbaek](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/huulbaek/32/46692_2.png) [@huulbaek](https://meta.discourse.org/u/huulbaek)
#### Post date: [09.Октябрь.2015 16:51:00 UTC](https://meta.discourse.org/t/problems-after-import-from-semi-large-forum/34033/6 "2015-10-09T16:51:00Z")

</div>

It eventually worked, increasing the workers. However, it still took more than 48 hours on a DigitalOcean 16GB droplet. But thanks! 😄

---

<div class="post-metadata">

### Author: ![JammyDodger](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/jammydodger/32/254611_2.png) [@JammyDodger](https://meta.discourse.org/u/JammyDodger)
#### Post date: [08.Июнь.2024 12:46:05 UTC](https://meta.discourse.org/t/problems-after-import-from-semi-large-forum/34033/7 "2024-06-08T12:46:05Z")

</div>

Эта тема была автоматически закрыта через 3172 дня. Новые ответы больше не принимаются.
