Digital Ocean’s 10$ / month VPS seems to be the prefered cheap VPS around here to install discourse.
It’s easier to backup your data via the admin interface. Reinstall elsewhere (installation is rather quick) and then restore via the admin interface of your fresh install.