# Finding UI generated backup and restoring site
**URL:** https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202
**Category:** Support
**Created:** [April 9, 2021, 12:54pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202 "2021-04-09T12:54:15Z")
**Posts on this page:** 20
**Page:** 1
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 12:54pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/1 "2021-04-09T12:54:15Z")
Hi Discourse,
Last night I was pushing through the Discourse upgrades and rebuilt the app, which resulted in a host of Postgres errors. I realized this was a result of the recent upgrade, but kept getting permission denied errors, among other things (and yes, I chowned everything to 700 so it wasn’t global). So I moved my original /var/discourse somewhere that was supposed to be temporary and reinstalled a fresh instance of Discourse to try and at least get postgres up to date.
Here’s where it gets fun. I had a backup of the site (DB only, uploads are saved to a different volume) generated by the UI from three days ago. Or at least, I thought I did. What I have now is a file called **wacky-writers-forum-2021-04-06-033906-v20210328233843.sql.gz** which I think I’ve learned is not, in fact, the tar.gz file the actual backup should be in.
I have everybody redirected to a landing page currently, and I’m hoping someone may be able to tell me that it is still possible to retrieve the actual .tar.gz file from the server from 3 days ago, and how, exactly I should go about doing that.
I have my backups and uploads saving to Digital Ocean block storage, and I still have the discourse folder from my old install that was functional, but moving/copying it back over to /var/discourse just breaks everything all over again, including throwing postgres errors. I’ve been working on this for 9 hours straight and I’m just about at my wits’ end. Can anybody help me, or at least try to point me in the right direction? 🙏 We just hit our 1k user mark and I would really really like to try and avoid losing all of that.
Edited to amend my upload setup.
---
### Author:  [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [April 9, 2021, 1:01pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/2 "2021-04-09T13:01:33Z")
If your have your S3 configuration in the app.yml then your can just do a commend line restore and it’ll pull the backup from s3.
Since you have your assets in S3, the backup contains only the database.
You should just be able to clone a new /var/discourse, copy your yml file, rebuild, and do the command line restore.
[Using Object Storage for Uploads (S3 & Clones)](https://meta.discourse.org/t/using-object-storage-for-uploads-s3-clones/148916)
[Restore a backup from command line](https://meta.discourse.org/t/restore-a-backup-from-command-line/108034)
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 1:08pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/3 "2021-04-09T13:08:18Z")
> [@pfaffman](#):
>
> If your have your S3 configuration in the app.yml then your can just do a commend line restore and it’ll pull the backup from s3.
I guess I’m using the wrong term for how my backups/uploads are set up. I used this method: [Move Uploads and Backups to DigitalOcean Block Storage](https://meta.discourse.org/t/moving-uploads-and-backups-to-digitalocean-block-storage/89274)
I’ll amend that and say my uploads and backups aren’t local to the main discourse folder (it’s partially how this all got started, I was working on trying to move us to DigitalOcean Spaces). So, no, unfortunately, I don’t have any of the S3 configurations done since I was just saving it to mounted storage.
The backups were being saved in mnt/my\_storage/shared/standalone, but when I go to look for backups in there, all I have is the **wacky-writers-forum-2021-04-06-033906-v20210328233843.sql.gz** file. I did actually try to restore from that for lack of a better idea (which was probably wrong), but I got a permission denied error. I’m sure it’s something to do with how those backups are actually generated.
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [April 9, 2021, 1:48pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/4 "2021-04-09T13:48:47Z")
So are your uploads still on the DO block storage?
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 1:49pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/5 "2021-04-09T13:49:12Z")
Yes, all the uploads are intact.
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [April 9, 2021, 1:50pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/6 "2021-04-09T13:50:28Z")
Ok, good.
So in that case you should be able to restore the SQL file, and then re-mount the block storage volume to get your uploads back.
There are two kinds of backups: `sql.gz` which does not include uploads, and `tar.gz` which does include uploads. So you had the wrong kind of backup but the fact that you had the uploads on an external volume saved your butt.
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 1:53pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/7 "2021-04-09T13:53:01Z")
> [@RGJ](#):
>
> So in that case you should be able to restore the SQL file, and then re-mount the block storage volume to get your uploads back.
So I enter the app and restore that sql.gz, but get a permission denied error. Any idea why that might be?
> [@RGJ](#):
>
> So you had the wrong kind of backup but the fact that you had the uploads on an external volume saved your butt.
You’re telling me!! 🙂
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [April 9, 2021, 1:55pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/8 "2021-04-09T13:55:00Z")
> [@CJtheSiteWizard](#):
>
> I chowned everything to 700 so it wasn’t global
(Assuming you mean chmod). If the files are set to the wrong owner then they’re not writable.
I think this might have _caused_ the permission denied.
What is the exact error?
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 1:59pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/9 "2021-04-09T13:59:10Z")
> [@RGJ](#):
>
> (Assuming you mean chmod).
Yes, thank you, I’ve been up all night and am a bit braindead.
> [@RGJ](#):
>
> What is the exact error?
```
EXCEPTION: lib/discourse.rb:93:in `exec': Failed to copy archive to tmp directory.
cp: cannot open '/var/www/discourse/public/backups/default/wacky-writers-forum-2021-04-06-033906-v20210328233843.sql.gz' for reading: Permission denied
```
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [April 9, 2021, 2:04pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/10 "2021-04-09T14:04:51Z")
Try `chmod 644 /var/www/discourse/public/backups/default/*`
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 2:24pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/11 "2021-04-09T14:24:18Z")
Okay I’m working my way through this now, I’ll report back shortly. Thank you for taking time to help me out.
This worked to get the restore going, THANK YOU. 🙏
Now I just have to figure out why the site still isn’t loading. 😬
Rebuild currently in progress with saved app.yml file from before everything broke.
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 3:14pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/12 "2021-04-09T15:14:25Z")
Is there a command to move this backup straight into the app? Restore isn’t finding it and I can’t remember how I got it to load before.
---
### Author:  [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [April 9, 2021, 6:18pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/13 "2021-04-09T18:18:17Z")
YOu can download it from S3 and put it in
```
/var/discourse/shared/standalone/backups/default
```
You should be able to restore from the command line.
But after that, you should configure your S3 config as described in the link above; it makes things easier.
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 6:24pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/14 "2021-04-09T18:24:49Z")
> [@pfaffman](#):
>
> You should be able to restore from the command line.
>
> But after that, you should configure your S3 config as described in the link above; it makes things easier.
Thanks Jay. And yes that is absolutely my plan.
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 9, 2021, 8:06pm UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/16 "2021-04-09T20:06:25Z")
Okay so here’s where I am now.
- The restore was successful from that .sql.gz file. (hooray! Thanks again Richard.)
- I ensured app.yml was the same setup as before everything died
- ./launcher rebuild app
- Rebuild is successful with Postgres 13 (finally)
However, going to the site itself now is still down. I use Cloudflare but I have Development Mode on right now, and flushed the DNS cache. Everything is pointed where it’s supposed to go. The Cloudflare template is in app.yml.
DNS is resolving correctly, hostnames is up to date, the Discourse install was done with the appropriate URL, and I’m running out of ideas.
[https://forum.wackywriters.com](https://forum.wackywriters.com) is the URL, I’m just getting “server unavailable” errors. I feel like I’m going around in circles here (sorry) but any suggestions?
Edit: When I run ./discourse-doctor, I see that there are two instances of the app running in Docker:
Is this normal? (seems like it wouldn’t be, but everything I thought I knew about Discourse has been thrown out the window the last 24 hours 😅 )
Edit2: I’ve been putting this off as a last resort, but I’m going to try and set up an entirely new server with a clean Discourse install. I’m worried something has gotten fubared with all my mucking around and I can’t figure out what’s broken. Thankfully I still have the backup and all the uploads on block storage, so if I’m lucky, I should be able to connect that to a new droplet and move things over from there. If anyone has additional suggestions or tips, I’d still appreciate more tenured expertise than mine.
Edit3: Even with a new server and IP propagating (nslookup and ping both look good, [whatsmydns.net](http://whatsmydns.net) looks good), forum won’t load. Still getting connection errors. It’s like it isn’t connecting the IP address to the Discourse instance and instead is trying to load a static page, which of course, doesn’t exist in this case.
---
### Author:  [@CJtheSiteWizard](https://meta.discourse.org/u/CJtheSiteWizard)
#### Post date: [April 10, 2021, 1:15am UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/17 "2021-04-10T01:15:20Z")
So after almost 24 hours of fighting, I figured out why the site refused to load after I got the restore going.
👇
> [@After initial setup of DigitalOcean droplet, get Refused to Connect error](https://meta.discourse.org/t/after-initial-setup-of-digitalocean-droplet-get-refused-to-connect-error/45002/4):
>
> Just to point out something that happened to me. I used a testing server whose setup is entirely done by ansible, and after I use the site, I destroy it (ansible handles the destruction of the droplets, digital ocean spaces and so on, so that I’m not charged when not using). What happened is that LetsEncrypt have rate limits, and my domain exceeded, so I started receiving the error that the page couldn’t be reached and it was a bit hard to track the reason to the rate limit of certificates (fir…
Because of so many resets and reinstallations and god knows what else, I hit the rate limit, so I’ve temporarily commented out the ssl templates and will get them going again in a week.
The site is “functioning” while I rebake all posts to fix the broken images but I really appreciate Jay and Richard for helping me out today, you got me through the parts I really just couldn’t figure out.
Now to get a _real_ backup downloaded so I can get S3 setup this week without worrying about this again. 😅
---
### Author:  [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [April 10, 2021, 2:05am UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/18 "2021-04-10T02:05:39Z")
If you search, there is a way to add a second domain so that it’ll count as a separate request for let’s encrypt. But waiting is easier.
I recommend that you put cloudflare to gray cloud with no speedups.
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [April 10, 2021, 11:38am UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/19 "2021-04-10T11:38:00Z")
> [@pfaffman](#):
>
> from S3
@pfaffman Aren’t you confusing object storage with block storage? Object storage is s3, but TS says they used block storage, which is just a disk mounted at their uploads directory:
> [@CJtheSiteWizard](#):
>
> I guess I’m using the wrong term for how my backups/uploads are set up. I used this method: [Moving uploads and backups to DigitalOcean Block Storage](https://meta.discourse.org/t/moving-uploads-and-backups-to-digitalocean-block-storage/89274)
---
### Author:  [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [April 10, 2021, 11:42am UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/20 "2021-04-10T11:42:14Z")
> [@RGJ](#):
>
> @pfaffman Aren’t you confusing object storage with block storage?
Oh. 🤦♂️
Yeah. So nothing I said makes any sense.
Thanks for noticing that, Richard.
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [April 10, 2021, 11:47am UTC](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202/21 "2021-04-10T11:47:07Z")
> [@pfaffman](#):
>
> So nothing I said makes any sense.
Well, _most_ things you said _did_ make sense but you had me confused here 🙂
[Next page](https://meta.discourse.org/t/finding-ui-generated-backup-and-restoring-site/186202.md?page=2)