# Import Script High Memory Usage

**URL:** <https://meta.discourse.org/t/import-script-high-memory-usage/153471>\
**Category:** Product Support\
**Created:** [June 1, 2020, 2:04pm UTC](https://meta.discourse.org/t/import-script-high-memory-usage/153471 "2020-06-01T14:04:30Z")\
**Posts on this page:** 1\
**Showing post:** 6

<div class="post-metadata">

**Author:** ![pfaffman](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/pfaffman/32/120154_2.png) [@pfaffman](https://meta.discourse.org/u/pfaffman)\
**Post date:** [June 1, 2020, 2:42pm UTC](https://meta.discourse.org/t/import-script-high-memory-usage/153471/6 "2020-06-01T14:42:53Z")

</div>

See [discourse/script/bulk\_import at main · discourse/discourse · GitHub](https://github.com/discourse/discourse/tree/master/script/bulk_import).

For topics and posts it’s not really feasible to run parallel imports anyway, as you can’t import a post in a topic if the topic and all previous posts are not already imported. I suppose you could have parallel processes for users and topics, but not for posts unless you re-write the script to pull in all the posts for a topic, which would allow parallel imports; that is certainly do-able, but not the way that any of the scripts that I’ve used works. But you’ll still have the problem with them keeping in ram an old-to-new ID map.

Importing 25M posts isn’t convenient. 🙂

---

_[View the full topic](https://meta.discourse.org/t/import-script-high-memory-usage/153471)._
