Can I install discourse on this unmanaged vps? If yes how to?

You need this link: Discourse official Standard Installation

There are many providers of VPS. Consider Digital Ocean, Hetzner, Scaleway too.

Checkout discussions in #hosting