In ~6 years of running one site I’ve not had a single event of data loss due to the software - that’s how stable and reliable the Discourse tech stack is (inc. the incredible Linux).
You can take a snapshot of a VPS usually at any time, but the daily backups are more than good enough imho.
the data folder is /var/discourse/shared
you should keep a copy of app.yml somewhere safe too.