# Import HTML site to Discourse?

**URL:** https://meta.discourse.org/t/import-html-site-to-discourse/120474
**Category:** Migration
**Created:** [June 15, 2019, 10:27pm UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474 "2019-06-15T22:27:53Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![Timelord](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Timelord](https://meta.discourse.org/u/Timelord)
#### Post date: [June 15, 2019, 10:27pm UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474/1 "2019-06-15T22:27:54Z")

</div>

Hey gang.

Is there any way to import a “wget” scrape of an old forum? I would like to move it to Discourse, but I do not have the SQL file. Old forum is based on Xenforo.

[This thread](https://meta.discourse.org/t/archive-an-old-forum-in-place-to-start-a-new-discourse-forum/13433) gives me hope

---

<div class="post-metadata">

### Author: ![csmu](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/csmu/32/124581_2.png) [@csmu](https://meta.discourse.org/u/csmu)
#### Post date: [June 15, 2019, 11:09pm UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474/2 "2019-06-15T23:09:02Z")

</div>

> [@Timelord](#):
>
> Is there any way to import a “wget” scrape of an old forum?

If you can parse out the html the answer would be yes.  
I recommend using wget and looking through the html for the structure.  
You might end up scaping the site with something like [puppeteer.](https://github.com/GoogleChrome/puppeteer).

---

<div class="post-metadata">

### Author: ![Timelord](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Timelord](https://meta.discourse.org/u/Timelord)
#### Post date: [June 16, 2019, 1:02pm UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474/3 "2019-06-16T13:02:52Z")

</div>

> [@csmu](#):
>
> If you can parse out the html the answer would be yes.  
> I recommend using wget and looking through the html for the structure.

HI there.

I already have a full scrape of the site, I am looking for a way to import the HTML files into discourse usable content. I know it’s a long shot, but worth at least asking about

---

<div class="post-metadata">

### Author: ![pfaffman](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/pfaffman/32/120154_2.png) [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [June 16, 2019, 2:38pm UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474/4 "2019-06-16T14:38:00Z")

</div>

So this is a site that you don’t control/own and you scraped? Why don’t you have access to the database?

It’s hard to say without knowing more about what the data look like. Is the site online somewhere?

Anything is possible. Do you want users imported too? Do you have email addresses? Are there user profile files?

How many topics and posts are there? Is there one topic per html file? One post per file?

For a frame of reference, I’d not consider such a job for less than $5000. And I it’s not likely to be pretty when it’s done.

---

<div class="post-metadata">

### Author: ![csmu](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/csmu/32/124581_2.png) [@csmu](https://meta.discourse.org/u/csmu)
#### Post date: [June 16, 2019, 2:38pm UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474/5 "2019-06-16T14:38:33Z")

</div>

> [@Timelord](#):
>
> I am looking for a way to import the HTML files into discourse usable content.

If you know … or are willing to learn … how to code in Ruby, and the html structure is elegant enough … it’s not a long shot.

It’s entirely doable.

---

<div class="post-metadata">

### Author: ![pfaffman](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/pfaffman/32/120154_2.png) [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [June 16, 2019, 2:49pm UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474/6 "2019-06-16T14:49:32Z")

</div>

The mailing list importer is probably a good place to start. You could pull the data into sqlite and go from there.

---

<div class="post-metadata">

### Author: ![system](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/system/32/443519_2.png) [@system](https://meta.discourse.org/u/system)
#### Post date: [November 24, 2022, 3:19am UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474/7 "2022-11-24T03:19:00Z")

</div>



---

<div class="post-metadata">

### Author: ![JammyDodger](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/jammydodger/32/254611_2.png) [@JammyDodger](https://meta.discourse.org/u/JammyDodger)
#### Post date: [November 24, 2022, 8:01am UTC](https://meta.discourse.org/t/import-html-site-to-discourse/120474/8 "2022-11-24T08:01:12Z")

</div>


